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CHAPTER  I 


INTRODUCTION 

General  Issue 

Today’s  weapon  systems  and  their  associated  mainte- 

r 

nance  tasks  are  extremely  complex.  The  present  U.  S.  defense 
policy,  which  relies  heavily  on  qualitative  superiority  in 
weapons  design  and  implementation,  requires  equally  superior 
1  maintenance  support  and  equipment.  As  weapon  systems  became 

more  electronically  complex,  manual  equipment  testing  and 
fault  detection  became  impractical.  The  solution  seemed  to 
be  automatic  testing  with  mechanized  and,  ultimately, 
computer-controlled  devices.  Generically,  all  of  these 
1  devices  are  known  as  Automatic  Test  Equipment  (ATE),  offi-  . 

dally  defined  as  follows: 

Devices  designed  and  capable  of  automatically  measuring 
selected  parameters  of  an  item  .  .  .  being  tested  and 
making  a  comparison  to  accept  or  reject  measured 
values  in  accordance  with  predetermined  limits. 

(School  of  Systems  and  Logistics,  1981,  p.  79) 

ATE  was  initially  supposed  to  bridge  the  gap  between 

f  the  highly  complex  device  and  the  more  limited  skills  of  the 

i 

average  maintenance  technician.  This  strategy  had  short¬ 
comings  which  are  now  becoming  apparent.  Built-in-Test 
Equipment  (BITE  or  BIT)  is  internal  to  the  weapon  system  and 
allows  operator  or  technician  on-line  fault  detection  and 
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isolation.  The  "false  pull"  occurs  when  the  BITE  identifies 
a  malfunctioning  component  but  subsequent  diagnostics  show 
no  apparent  equipment  failure.  These  false  pulls  are  budget 
breakers  in  terms  of  money  and  man-hours.  Several  studies 
indicate  unnecessary  removal  rates  on  modern  weapon  systems 
to  be  anywhere  from  20  to  89  percent  (Herner,  Miller  &  Genet, 
1981;  Institute  of  Defense  Analyses,  1981;  King,  1982). 

Background 

Heavy  reliance  on  electronics  in  advanced  weaponry 
has  created  an  urgent  need  for  faster  and  more  sophisticated 
testing  methods.  Approximately  one-third  of  the  Air  Force 
equipment  inventory  is  electronic.  Furthermore,  the  270 
million  dollar  1982  funding  for  electronics  research  was 
more  than  the  total  request  for  weaponry,  flight  vehicles, 
or  propulsion  and  power  research  (Bryson,  Husby  &  Webb,  1982). 
Avionics  is  a  particular  breed  of  electronics  vital  to  vir¬ 
tually  all  advanced  airborne  weapon  systems.  Economically, 
avionics  comprise  approximately  one-half  the  total  value  of 
modern  aircraft  (Owens,  St.  John  &  Lamb,  1977).  Associated 
maintenance  costs  for  avionics  are  also  on  the  rise  due  to: 

(1)  an  exponential  Increase  in  avionics  complexity  with 
respect  to  time  and  (2)  the  inflation  of  people  costs 
in  this  labor  intensive  field.  (Owens,  St.  John  &  Lamb, 
1977,  p.  1) 

Reducing  avionics  maintenance  became  a  high  level 
attention  item  with  regard  to  the  above  costs.  One  solution, 
automatic  testing,  was  proposed  to  provide  more  precise 


2 


measurements,  greater  reliability,  fewer  human  errors,  and 
reduced  testing  and  training  costs.  These  benefits  did  not 
appear  quickly,  and,  in  fact,  the  rapid  rise  of  ATE  caused 
significant  problems  involving  virtually  all  operation  and 
maintenance  aspects  (Gutmann,  1980).  The  military  applica¬ 
tion  of  ATE  to  weapon  systems  resulted  in  unforeseen  design, 
training,  and  operational  problems.  ATE  was  originally 
designed  to  help  solve  the  problem  of  high  weapon  systems 
complexity  and  dwindling  highly  skilled  technicians.  How¬ 
ever,  high  error  rates  negated  these  benefits. 

With  a  30 %  false  pull  rate,  it  is  easy  to  understand 
the  concern  of  the  Air  Force  in  .  .  .  designing  new 
systems  such  that  BIT  (Built-in-Test)  will  inherently 
have  a  lower  rate.  (Herner,  Miller  &  Genet,  1981,  p.  1) 

In  reducing  this  error  rate,  design  must  include  better 

tolerance  indications  and  ease  of  making  tolerance  changes 

in  the  field.  Also,  the  environmental  effects  on  decision 

error  rate  must  be  Included  in  the  design  phase  (Herner, 

Miller  &  Genet,  1981). 

The  airline  industry,  as  well  as  the  Air  Force,  is 
making  increasing  use  of  BIT.  However,  airline  maintenance 
personnel  have  widely  ignored  BIT  systems  because  of  the  lack 
of  agreement  between  the  BIT  fault  indication  and  the  flight 
crews'  reported  discrepancy.  An  unnecessary  removal  is 
defined  as  a  unit  removed  from  the  system  that  does  not  con¬ 
tain  a  failure  when  examined  at  a  subsequent  level  of  main¬ 
tenance.  "Airlines  find  that  far  less  than  50  percent  of 
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boxes  removed  contain  verified  failures”  (Institute  of 
Defense  Analyses,  1981,  p.  7). 

In  the  Air  Force,  the  problem  in  the  field  is  not 

the  detection  of  the  fault  but  rather  too  many  false  alarms. 

BIT  equipped  weapon  system  electronic  subsystems  (and 
equipment)  being  introduced  into  the  field  are  not 
meeting  the  diagnostic  specifications  which  are  gen¬ 
erally  in  the  range  of  90  to  95  percent  probability 
of  automatic  (or  semi-automatic)  fault  detection  and 
isolation.  .  .  .  experience  shows  that  20  to  40  per¬ 
cent  of  the  items  which  were  replaced  because  of  a 
failure  indication  by  BIT  are  later  found  to  have  no 
failure.  (Institute  of  Defense  Analyses,  1981,  p.  S-2) 

A  false  alarm  is  defined  as  "an  operator  reported  failure 

indication  that  cannot  be  confirmed  by  maintenance  personnel" 

(Institute  of  Defense  Analyses,  1981,  p.  S-5).  A  study  at 

Rome  Air  Development  Center  (RADC)  involving  nine  different 

Air  Force  systems  at  numerous  bases  found  unnecessary  removal 

rates  on  the  order  of  40  percent  with  some  systems  as  high 

as  89  percent  (Institute  of  Defense  Analyses,  1981). 

Removal  of  units  from  the  aircraft  is  performed  by 
Organizational  level  (0-level)  personnel  and  tested  by  Inter¬ 
mediate  level  (I-level)  technicians  using  ATE.  The  situation 
where  O-level  maintenance  verifies  the  reported  fault  but 
I-level  maintenance  tests  the  unit  and  finds  no  fault  Is 
termed  a  Retest-OK  or  RTOK  (Institute  of  Defense  Analyses, 
1981).  A  similar  situation  occurs  on  the  flightline  when 
the  0-level  technician  troubleshoots  a  reported  malfunction 
but  is  unable  to  reproduce  the  symptoms.  This  is  termed  a 
Cannot-Duplicate  or  CND  condition.  RTOK  and  CND  rates 
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imply  that  significant  personnel  and  equipment  resources 
are  expended  troubleshooting,  removing,  retesting,  and 
replacing  "good”  avionics,  thus  reducing  aircraft  avail¬ 
ability  and  increasing  support  costs.  (King,  1982,  p.  1) 

In  1970  the  Deputy  Secretary  of  Defense  requested 
proposals  for  new  weapon  systems  which  would  help  stem 
exponentially  rising  defense  costs.  The  Air  Force  proposal 
called  for  a  new  lightweight  fighter,  the  YF-16.  When 
selected  to  join  the  inventory,  the  F-16  Fighting  Falcon 
carried  with  it  many  new  complex  systems.  The  sophisticated 
avionics  system  included  radar,  an  Inertial  Navigation  Sys¬ 
tem  (INS),  flight  control  computer,  communications  equipment, 
and  fire  control  system.  An  integral  component  of  U.  S. 
defense,  the  F-16  must  be  kept  operationally  ready.  "It  may 
be  safely  predicted  that  the  F-l6  will  be  in  quite  a  few  Air 
Force  Inventories,  and  no  doubt  in  our  own,  well  after  the 
year  2000"  (Norton,  1983,  pp .  10- HO. 

As  a  front  line  fighter  replacement  for  the  F-4 
Phantom,  the  F-16  maintenance  plan  makes  extensive  use  of 
Self  Test  (ST),  BIT,  and  ATE  as  diagnostic  aids  in  maintain¬ 
ing  this  highly  complex  weapon  system.  ST  is  defined  as 

test  equipment  that  performs,  through  test  sequences, 
two  or  more  individual  tests  without  requiring  initia¬ 
tion  by  or  assistance  from  the  operator.  (School  of 
Systems  and  Logistics  1981,  p.  617) 

Figure  1  indicates  the  current  F-16  ST/BIT  Support  Concept 

(General  Dynamics,  1975).  The  general  requirements  for  the 

F-16  System  specification  (16PS001)  states  that  the  ST/BT 

requirements  are: 


SELF-TEST/BUILT-INTEST  SUPPORT  CONCEPT 


remove  and  replace  aircraft  equipment  without  the 
need  for  adjustment  except  as  provided  by  BIT  capa¬ 
bility  .  .  .  minimum  requirement  for  flightline  sup¬ 
port  equipment  for  avionics  .  .  .  maximum  use  of 
ST/BIT  for  avionics  system  checkout  and  fault  isola¬ 
tion.  (Institute  of  Defense  Analyses,  1981,  p.  ^6) 

Recent  studies  show  diagnostic  error  rates  anywhere  from 
25  to  69  percent  are  being  experienced  on  the  P-16  (Insti¬ 
tute  of  Defense  Analyses,  1981).  One  of  the  subsystems 
experiencing  a  high  CND/RTOK  rate  (25.8  percent  and  30  per¬ 
cent  respectively)  is  the  APG-66  Fire  Control  Radar  built 
by  Westinghouse  Corporation  (Institute  of  Defense  Analyses, 
1981;  Baran,  1983). 

The  APG-66  is  an  improved  programmable  radar  that 
allows  the  pilot  to  detect,  track,  prioritize,  and  engage 
multiple  beyond-visual-range  targets  simultaneously.  The 
Fire  Control  Radar  consists  of  six  functional  Line  Replace¬ 
able  Units  (LRUs).  An  LRU  is  defined  as: 

an  item  that  is  normally  removed  and  replaced  as  a 
single  unit  to  correct  a  deficiency  or  malfunction  on 
a  weapon  or  support  system.  .  .  .  any  assembly  which 
can  be  removed  as  a  unit  from  the  system  at  the  operat¬ 
ing  location.  (School  of  Systems  and  Logistics,  1981, 
p.  393) 

The  six  functional  LRUs  are  Antenna,  Transmitter,  Control 
Panel,  Low  Power  Radio  Frequency  (LPRF),  Digital  Signal  Pro¬ 
cessor,  and  Computer.  Figure  2  depicts  their  pictorial 
representation  (Morehead,  Brinkman  &  Chambers,  1979).  The 
LPRF  has  been  involved  in  a  significant  number  of  flightline 
CND  Incidents  and  exhibits  a  high  RTOK  rate  (approximately 
45  percent)  relative  to  other  radar  LRUs  (Westinghouse 
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Electric  Corporation,  1983).  The  specific  requirements  of 
the  Air  Vehicle  Specification  (16PS002)  for  the  F-16  state 
that  the  Fire  Control  Radar  should  detect  and  isolate  to  the 
LRU  for  95  percent  of  malfunctions  and  that  false  alarms 
should  be  less  than  one  percent  (Institute  of  Defense  Analy¬ 
ses,  1981). 

There  is  a  justifiable  concern  in  the  Air  Force  to 
reduce  diagnostic  errors  on  fielded  systems.  The  costs  of 
increased  spares,  aircraft  turnaround  delays,  and  overloaded 
intermediate  shops  are  obvious.  ST,  BIT,  and  ATE  are  diag¬ 
nostic  aids  in  the  process,  but  the  decision  to  pull  or  not 
to  pull  an  LRU  is  made  by  people  not  machines  (Westinghouse 
Electric  Corporation,  1981). 

Scope  of  Research 

Numerous  weapon  systems,  subsystems,  and  components 
have  abnormally  high  CND/RTOK  rates.  This  research  is 
limited  to  a  specific  LRU  that  exhibits  these  characteristics. 
The  F-16  Fire  Control  Radar  LPRF  was  chosen  as  the  candidate 
LRU  to  be  examined  based  upon  its  representative  modern 
technological  design,  high  CND/RTOK  rates,  and  accurate, 
readily  available  maintenance  data.  To  complement  an  ongoing 
Air  Force  Human  Resources  Laboratory  (AFHRL)  study,  the 
present  maintenance  operations  and  data  from  the  56th  Tacti¬ 
cal  Fighter  Training  Wing  (TFTW),  MacDill  AFB,  Florida  are 
used  as  a  basis  for  this  research  project. 
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Many  quantitative  techniques  or  models  could  be 
used  to  examine  the  maintenance  process.  In  particular, 
queueing  theory  has  been  shown  to  be  a  valuable  quantitative 
tool  in  the  evaluation  of  the  repair  cycle  for  weapon  sys¬ 
tems  and  equipment  (Anderson,  Sweeney  &  Williams,  1982). 

The  F-16  repair  cycle  can  be  viewed  as  a  waiting 
line  problem  in  which  LRUs  fail  (O-level)  and  subsequently 
arrive  at  the  intermediate  shop  for  service  by  the  ATE. 
"Inherent  in  queueing  theory  is  a  system  of  arrivals,  queues, 
servers,  and  exit  from,  or  return  to,  the  system"  (Bryson, 
Husby  &  Webb,  1982,  p.  13)-  The  queueing  model  representa¬ 
tion  of  this  repair  cycle  will  be  presented  in  more  detail 
in  Chapter  II. 


Problem  Statement 

A  problem  exists  with  false  removals  of  avionics 
equipment  aboard  the  F-l6  Fighting  Falcon.  False  pulls  are 
costly,  time  consuming,  and  ultimately  lead  to  flight  crew 
and  maintenance  technicians'  complete  disregard  of  reported 
malfunctions.  There  is  a  need  to  improve  systems  level  test 
accuracy  and  reduce  CND  and  RTOK  rates. 

Research  Objective 

A  simulation  model  of  the  maintenance  diagnostic 
process  will  be  used  to  evaluate  the  impact  of  decision 
errors  or.  F-16  aircraft  availability.  Evaluation  will  be 
base!  or.  sensitivity  analysis  of  key  decision  variables. 
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The  effects  of  improved  decisions  resulting  in  "correct" 
(valid  and  consistent)  maintenance  actions  will  be  simulated 
by  varying  the  CND/RTOK  coefficients  in  the  model.  Thus, 
sensitivity  analysis  will  determine  those  decision  points 
where  study  in  greater  depth  is  justified  and  money/manpower 
can  be  saved. 


Research  Question  # 1 

Can  a  queueing  simulation  model  of  the  F-16  radar 
LPRF  maintenance  diagnostic  process  be  developed  using  esti¬ 
mated  probability  distributions  and  descriptive  parameters 
for  test  and  repair  times  and  decision  point  variables? 

Research  Question  #2 

Can  sensitivity  analysis  of  key  decision  variables 
be  used  to  determine  the  effects  of  CND/RTOK  rates  on  F-16 
aircraft  availability? 
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CHAPTER  II 


RESEARCH  METHODOLOGY 

Introduction 

This  thesis  approaches  avionics  maintenance  with  a 
total  system  view.  Although  the  F-16  LPRP  maintenance  diag¬ 
nostic  process  is  highly  complex,  simulation  techniques  will 
enable  overall  analysis  of  the  subprocesses  involved. 

Further  analysis  will  provide  opportunities  to  make  tenta¬ 
tive  conclusions  as  to  where  improved  diagnostic  decisions 
or  equipment  capabilities  are  warranted. 

Queueing  Theory 

"Quantitative  models  have  been  developed  to  help  man¬ 
agers  understand  and  make  better  decisions  concerning  the 
operations  of  waiting  lines"  (Anderson,  Sweeney  &  Williams, 
1982,  p.  552).  Therefore,  describing  the  F-16  repair  cycle 
with  a  queueing  model  provides  for  effective  systems  approach 
analysis  and  decision  making.  The  required  queueing  scenario 
of  arrivals,  waiting  lines,  server  stations,  and  exit  from 
the  system  to  be  modeled  is  readily  apparent  in  the  F-16 
maintenance  process.  Figure  3  represents  this  process 
(General  Dynamics,  1975).  Upon  LPRF  failure,  a  requirement 
exists  for  subsequent  repair  at  the  0  and  I-level  maintenance 
subsystems.  These  subsystems  can  be  viewed  as  processes 
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including  waiting  lines  with  associated  servicing  activities 
which  allow  return  of  the  LPRF  to  a  serviceable  state. 


Queueing  theory  is  not  only  invaluable  for  evaluat¬ 
ing  weapon  systems’  repair  cycles,  but  it  also  lends  itself 
easily  to  further  complex  modeling  using  computer  resources. 
Queueing-Graphical  Evaluation  and  Review  Technique  (Q-GERT) 
is  one  such  computerization  vehicle. 


Q-GERT  Modeling 

Q-GERT  is  a  fairly  recent  computer  analysis  tech¬ 
nique  incorporating  graphical  systems  modeling  in  a  network 
form.  Readers  interested  in  a  detailed  description  of  Q-GERT 
techniques  should  refer  to  Pritsker  (1979).  In  general, 

GERT  is  an  extension  of  the  Program  Evaluation  Review  Tech¬ 
nique  (PERT)  and  the  Critical  Path  Method  (CPM)  of  analysis. 
Q-GERT  networks,  the  graphical  underpinnings  of  the  tech¬ 
nique,  offer  detailed  representation  of  activities,  servers, 
and  queues. 

Q-GERT  has  been  designed,  developed  and  used  for  study¬ 
ing  the  procedural  aspects  of  manufacturing,  defense 
and  service  systems  [emphasis  added].  (Pritsker,  1979, 
p.  vii) 

The  Q-GERT  modeling  philosophy  involves  a  systems 

approach  composed  of  four  steps. 

First,  a  system  is  decomposed  into  its  significant 
elements.  Second,  the  elements  are  analyzed  and  des¬ 
cribed.  Third,  the  elements  are  integrated  in  a  net¬ 
work  model  of  the  system.  Fourth,  system  performance 
is  assessed  through  the  evaluation  of  the  network 
model.  (Pritsker,  1979,  p.  viii) 


A  systems  approach  to  modeling  the  P-16  LPRP  repair  cycle 
is  necessary  for  a  realistic  analysis  of  numerous  interde¬ 
pendent  activities.  Then,  appropriate  statistical  analysis 
techniques  can  be  performed  to  evaluate  selected  subsystems. 

Systems  Science  Paradigm 

To  apply  the  systems  modeling  approach  to  an  opera¬ 
tional  setting,  we  must  employ  an  iterative  process  approach 
to  problem  solving.  We  will  implement  the  Systems  Science 
Paradigm  which  consolidates  the  systems  approach  for  model 
development  into  three  distinct  phases  (Schoderbek,  Schoder- 
bek  &  Kefalas,  1980).  First,  the  conceptualization  phase 
provides  a  clear  statement  of  the  modeled  system's  purpose 
and  of  the  proposed  problem  under  investigation.  Next,  the 
analysis  and  measurement  phase  involves  the  development  of 
an  experimental  design  which  insures  adequate  analysis  of 
simulation  results  and  a  well  defined  parametric  model  con¬ 
sistent  with  actual  system  data.  Finally,  computerization 
of  the  previously  developed  structural  and  parametric  models 
of  the  system  enables  access  to  the  Q-GERT  program  and  its 
inherent  analytical  resources.  Detailed  accounting  of  these 
three  phases  is  presented  in  Chapter  III. 

The  Q-GERT  model  will  require  validation  before  we 
attempt  any  sensitivity  analysis  of  key  variables.  An 
expanded  explanation  of  the  testing  procedures  for  valida¬ 
tion  is  presented  in  the  Analysis  of  Results  plan. 


15 


r 


Data  Collection  Plan 

Data  collection  will  help  us  determine  decision 
point  coefficents  and  probability  distributions  associated 
with  failure  rates  and  repair  tines  of  the  LPRF.  Addition¬ 
ally,  parameters  for  the  probability  distributions,  such  as 
the  mean  and  standard  deviation,  will  be  estimated  from  the 
data.  Our  data  collection  process  will  include  extractions 
of  applicable  items  from  the  F-16  real  time  Centralized  Data 
System  (CDS).  Data  points  not  readily  available  in  the  CDS 
are  supplemented  by  the  F-16  Systems  Program  Office  (SPO). 

CDS  Data  Collection  System 

The  F-16  CDS  computer  system  is  a  real  time,  on-line 
data  base  designed  to  accommodate  the  data  normally  recorded 
under  the  manual  Maintenance  Data  Collection  system.  The 
overall,  objectives  of  the  CDS  are  to  provide  the  SPO  and 
real  time  users  with  information  for  the  management  of 
Avionics  Intermediate  Shop  (AIS)  test  stations  and  selected 
support  equipment,  up-to-date  and  accurate  F-16  related 
data  for  effective  weapon  system  support,  and  a  central 
source  for  maintenance  data  from  all  operational  bases 
(Dynamics  Research  Corporation,  1982). 

CDS  provides  management  information  on  AIS  usage, 
mean  time  between  maintenance  actions,  mean  time  between 
demand,  LRU  status,  and  aircraft  availability  (Bryson,  Husby 
&  Webb,  1982).  Thus,  the  CDS  computer  system  allows  for 
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real  time  accessability  to  F-16  operations  and  maintenance 
data  and  is  the  primary  data  collection  source  for  this 
research . 

LRU  Data  Collection 

Through  access  to  the  F-16  SPO's  CDS  computer  system, 
we  will  collect  maintenance  data  on  the  LPRF  LRU,  work  unit 
code  7^AB0.  CDS  extractions  will  include  frequency  of  main¬ 
tenance  actions,  maintenance  times  for  AIS  testing,  corre¬ 
sponding  times  to  repair,  and  the  required  crew  size.  Our 
retrieval  of  data  will  include  the  following  maintenance 
action  taken  codes — A:  testing  and  repair,  B:  testing  with 
no  repair  required,  H:  cannot  duplicate  malfunction,  P: 
removal  of  faulty  LRU,  Q:  installation  of  serviceable  LRU, 
and  R:  remove  and  replace  LRU.  A  major  modification  of  the 
CDS  on-line  syntax  features  in  January  1982  significantly 
improved  input  data  accuracy  (Caracillo,  1983).  Therefore, 
data  collection  will  cover  the  period  from  1  February  1982 
through  31  January  1983- 

Data  Analysis  Plan 

To  run  the  Q-GERT  simulation  model,  we  must  deter¬ 
mine  decision  point  coefficients,  probability  distributions, 
and  parameters  for  the  distributions .  These  input  variables 
will  be  estimated  with  appropriate  statistical  techniques. 

Data  analysis  begins  with  the  determination  of  the 
respective  decision  point  probabilities  (coefficients)  of 
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the  maintenance  diagnostic  process.  Data  points  for  each 
action  taken  will  be  charted  on  a  decision  tree  network  to 
compute  these  decision  point  probabilities. 

Our  estimation  of  service  time  probability  distribu¬ 
tions  requires  time-to-test  and  time-to-repair  data  analysis. 
Data  points  for  selected  servicing  actions  submitted  to  the 
Statistical  Package  for  the  Social  Sciences  (SPSS)  produce 
a  histogram  of  the  activity.  The  graphical  representation 
is  then  compared  against  common  probability  distributions 
(i.e.,  normal,  lognormal,  exponential,  etc.)  for  similarity. 
Goodness  of  Fit  (GOF)  tests  confirm  or  reject  the  hypothesis 
that  the  perceived  probability  distribution  follows  the 
theoretically  specified  distribution  derived  from  the  histo¬ 
gram.  Condescriptive  statistics  drawn  from  the  histograms 
provide  estimated  means  and  standard  deviations  of  the  serv¬ 
icing  distributions. 

Analysis  of  Results  Plan 

We  will  run  the  model  only  after  data  analysis  and 
estimation  of  probability  distributions.  The  resultant  out¬ 
put  then  requires  further  analysis  to  determine  internal 
model  validity. 

Validation  is  the  process  of  building  an  acceptable 
level  of  confidence  that  the  simulated  data  agrees 
v/ith  the  real  data  closely  enough  that  an  inference 
about  the  simulation  is  a  valid  inference  about  the 
actual  system.  (Arnett,  1979,  p.  12) 

Our  validation  process  includes  internal  transaction 


18 


tracing  to  ensure  "correct”  paths  are  being  taken.  Further 
validation  of  Q-GERT  generated  probability  distributions 
confirms  appropriate  reflection  of  parametric  data  distri¬ 
butions.  Confirmation  requires  application  of  appropriate 
statistical  tests  (histogram  and  goodness  of  fit)  to  the 
generated  distributions. 

The  post  validation  process  begins  with  an  appro¬ 
priate  number  of  runs  to  determine  model  sensitivity  to  CND 
and  RTOK  coefficient  variability.  Arnett  (1979)  describes 
the  "key"  input  variable  identification  technique  as  follows 

By  systematically  varying  the  input  variables  and 
analyzing  their  effects  on  the  output  variables,  the 
input  variables  with  the  greatest  effect  on  output 
variables  were  identified.  (p.  37) 

This  sensitivity  analysis  helps  us  in  determining  how 

responsive  the  model  is  to  changes  in  input  variables  over 

an  appropriate  range  of  interest.  Statistical  significance 

of  these  results  is  tested  with  Analysis-of-Variance  (ANOVA) 

One  final,  important  question  concerning  overall  model 

validity  is  whether  or  not  it  makes  sense.  Shannon's  (1975) 

view  concerning  this  question  states  that: 

The  professional  judgement  of  the  people  most  inti¬ 
mately  familiar  with  the  design  and  operation  of  a 
system  is  more  valuable  and  valid  than  any  statistical 
test  yet  devised.  (p.  236) 

Model  Assumptions/Limitations 
The  following  are  assumptions  and  limitations  used 
in  the  model: 
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1.  The  AIS  test  stations  are  fully  operational  and 
allocated  exclusively  for  the  repair  of  the  LPRF. 

2.  LPRF  repair  is  considered  perfect;  i.e.,  units 
repaired  do  not  exhibit  subsequent,  immediate  failure. 

3.  LPRF  failures  are  the  only  factors  affecting 
aircraft  operational  readiness  status. 

*4.  LPRF  failures  and  repair  times  are  statistically 
independent  of  all  other  factors. 

5.  Servicing  characteristics,  such  as  ability, 
skill,  and  training  are  not  considered. 

6.  Simulation  is  based  upon  observable  factors  only. 
(We  cannot  know  the  probability  of  an  item  passing  a  test 
when  it  actually  has  malfunctioned.) 

Summary 

Research  Question  # 1 

The  methodology  to  be  used  to  answer  research  ques¬ 
tion  #1,  determining  probability  distributions  and  parameters 
for  test  and  repair  times  and  decision  point  variables  ,,  will 
consist  of  (1)  searching  the  CDS  computer  files  to  determine 
if  such  Information  is  available,  and  (2)  applying  histo- 
r  grams,  condescriptive  statistics,  and  goodness  of  fit  tests 

to  the  data  (when  appropriate)  to  estimate  distributions. 

Research  Question  #2 

Research  question  #2  is  a  sensitivity  analysis  of 
certain  key  decision  variables  upon  the  output  of  the  Q-GERT 
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model.  Research  question  it 2  asks  if  changes  in  F-l6  air¬ 
craft  availability  occur  when  the  CND/RTOK  rates  are  varied. 
Analysis  of  Variance  (ANOVA)  tests  will  be  used  to  deter¬ 
mine  if  these  aircraft  availability  results  are  statistically 
significant . 
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CHAPTER  III 


RESEARCH  MODEL 

Introduction 

Our  Q-GERT  simulation  model  of  the  F-16  LPRF  main¬ 
tenance  diagnostics  process  relies  upon  the  three  phases 
of  the  Systems  Science  Paradigm  for  its  internal  structure. 
Therefore,  findings  follow  the  hierarchical  nature  of  this 
systems  analysis.  Phases  of  the  Systems  Science  Paradigm 
are:  (1)  Conceptualization;  (2)  Analysis  and  Measurement; 

and  (3)  Computerization  (Schoderbek,  Schoderbek  &  Kefalas, 
1930). 

The  first  phase,  conceptualization,  provides  a  clear 
statement  of  the  purpose  of  the  system  being  modeled  and  a 
structural  model  of  the  proposed  system's  behavior.  The 
analysis  and  measurement  phase  includes  development  of  a 
parametric  model  and  experimental  design  for  obtaining  sim¬ 
ulation  results.  The  final  phase,  computerization,  links 
the  structural  and  parametric  models  to  the  purpose  state¬ 
ment.  It  includes  a  Q-GERT  program  listing,  experimentation 
stages,  and  relevant  results  of  the  simulation  output  (Bobko, 
1933). 
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Phase  I:  Conceptualization 

This  model  simulates  the  present  maintenance  activi¬ 
ties  of  the  56th  TFTW,  MacDill  AFB,  Florida. 

Purpose  Statement 

Our  model  will  simulate  the  arrival,  waiting,  test¬ 
ing,  repairing,  and  return  of  the  F-16  Fire  Control  Radar 
LPRF  LRU  to  an  operational  state.  The  F-16  aircraft  has  a 
highly  complex,  multi-million  dollar  avionics  system  on 
board  to  enable  the  pilot  to  carry  out  his  assigned  mission. 
Because  of  the  complex  nature  of  this  system,  line  mainte¬ 
nance  personnel  are  not  allowed  to  perform  direct  mainte¬ 
nance  actions  on  the  individual  LRUs.  They  are  instead 
removed  and  replaced  with  operable  units  on  the  flightline. 
This  allows  quick  turnaround  for  the  aircraft  and  reduces  the 
.required  skill  level  of  flightline  personnel. 

The  model  of  the  F-16  LPRF  maintenance  diagnostic 
process  will  be  used  to  evaluate  the  impact  of  decision 
errors  on  aircraft  availability.  Evaluation  of  improved 
decisions  resulting  in  "correct"  (valid  and  consistent)  main¬ 
tenance  actions  will  be  simulated  by  varying  the  CND,  RTOK, 
and  combined  CND  ./RTOK  coefficients  in  the  model.  The  model 
will  show  where  increased  emphasis  in  improved  BIT  and  ATE 
capability  will  have  the  greatest  benefits. 

Structural  Model 

A  structural  model  of  the  F-16  LPRF  diagnostic 
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process  may  be  represented  with  a  causal  loop  diagram  (see 
Figure  4).  This  diagram  helps  provide  an  understanding  of 
the  key  component  interactions  and  insight  into  the  problem 
under  analysis. 

The  following  causal  loop  process  explains  the 
structural  model's  interactions  of  component  relationships. 
The  process  begins  when  an  operationally  ready  (OR)  aircraft 
is  written  up  for  L?RF  maintenance.  This  action  decreases 
the  number  of  OR  aircraft.  The  aircraft  LPRF  write-up  gen¬ 
erates  one  of  two  possible  maintenance  actions.  LPRF  write¬ 
ups  that  cannot  be  duplicated  (CND)  increase  the  number  of 
OR  aircraft.  Alternatively,  an  increased  number  of  trouble¬ 
shooting  actions  may  occur. 

Troubleshooting  leads  to  the  possibility  of  two 
flightline  corrective  actions.  The  first  action  increases 
the  number  of  LPRFs  removed  for  intermediate  level  mainte¬ 
nance  when  serviceable  LPRFs  are  not  immediately  available. 
Subsequent  receipt  of  serviceable  LPRFs  increases  the  number 
of  installed  LPRFs,  which,  in  turn,  results  in  increased  OR 
aircraft.  The  other  corrective  action  increases  the  number 
of  Immediately  replaced  LPRFs  with  a  serviceable  LPRF.  OR 
aircraft  are  once  again  increased. 

The  unserviceab1  ■.  LPRFs  removed  at  the  flightline 
increase  AI3  test  stati  c  use.  AIS  testing  can  be  in  one 
of  three  categories  resulci. ig  in  increased  bench  check  and 
repair  (BCRP),  bench  check  no  repair  (RTOK),  or  not 


repairable  this  station  (NRTS)  actions.  BCRP  and  RTOK 
actions  increase  the  number  of  serviceable  LPRPs  in  Base 
Supply.  NRTS  actions  increase  the  number  of  unserviceable 
LPRPs  sent  to  Depot  for  repair.  Receipt  of  Depot  repaired 
LPRPs  increases  the  number  of  serviceable  LPRFs  in  Base 
Supply.  The  number  of  serviceable  LPRFs  in  Base  Supply 
decrease  when  fulfilling  flightline  maintenance  action 
requirements . 

The  structural  model  is  based  upon  the  following 
assumptions : 

1.  Aircraft  are  considered  operationally  ready  (OR) 
or  not  OR  for  the  LPRF  only.  All  other  aircraft  systems  are 
considered  OR  at  all  times  in  this  model. 

2.  The  AIS  test  stations  are  fully  operational  and 
allocated  exclusively  for  testing  of  the  LPRF. 

3.  LPRF  repair  is  considered  perfect;  i.e.,  units 
repaired  do  not  exhibit  subsequent,  immediate  failure. 

4.  LPRF  failures  and  repair  times  are  statistically 
independent  of  all  other  factors. 

5.  Servicing  characteristics,  such  as  ability,  skill, 
and  training  are  not  considered. 

6.  Simulation  is  based  on  observable  factors  only. 

7.  The  maintenance  structure  and  operations  at 
MacDill  AFB,  Florida  are  representative  of  the  F-16  fleet  in 
a  peacetime  (training)  situation. 
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Phase  II:  Analysis  and  Measurement 
Parametric  Model 

The  structural  model  is  .used  as  a  foundation  for 
establishing  a  parametric  model.  Parameters  and  probability 
distributions  are  then  estimated  from  existing  data  sources. 

Data  sources  used  were  the  F-16  Centralised  Data 
System  (CDS),  the  F-16  Systems  Program  Office  (SPO),  Head¬ 
quarters  (HQ)  Tactical  Air  Command  (TAC)/Avionics  Division, 
and  HQ  Air  Force  Logistics  Command  ( AFLC ) /Analysis  and  Sup¬ 
port  Division.  Examples  of  data  obtained  from  the  F-16  CDS 
are  shown  in  Appendix  B.  The  F-16  SPO,  HQ  TAC/Avionics ,  and 
HQ  AFLC/Analysis  and  Support  Division  provided  data  not 
readily  available,  such  as:  number  of  test  stations,  number 
of  flightline  and  in-shop  personnel,  a  typical  F-16  daily 
flying  schedule,  and  depot  repair  times. 

Aircraft  Generation.  Interarrival  times  of  aircraft 
were  computed  using  a  typical  flying  day  in  a  training  situ¬ 
ation.  The  F-16  daily  flying  schedule  normally  consists  of 
2^  sorties.  All  flights  are  two-ship  formations  with  an 
average  duration  of  1.0  hours  (Stacey,  1983) . 

Table  I  shows  the  flying  schedule  and  the  computed 
interarrival  times.  These  times  were  computed  by  subtract¬ 
ing  the  initial  flight’s  landing  time  from  the  subsequent 
flight's  arrival  time.  Interarrival  times  are  presented  in 
tenths  of  hours. 
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Table  1 


Interarrival  Time  Data 
(Mean  =  0.5^3) 


Sortie 

Take-off 

Time 

Landing 

Time 

Interarrival 
Time  (Tenths) 

1 

0800 

0900 

0 

2 

0800 

0900 

0 

3 

0810 

0910 

.  17 

4 

0810 

0910 

.  17 

5 

0820 

0920 

.17 

n 

0820 

0920 

.17 

7 

0830 

0930 

.17 

3 

0830 

0930 

.  17 

9 

0840 

0940 

.17 

10 

O 

CO 

■l- 

0 

09^0 

.17 

11 

1100 

1200 

2.33 

12 

1100 

1200 

2.33 

13 

1110 

1210 

.17 

14 

1110 

1210 

.17 

15 

1120 

1220 

.17 

16 

1120 

1220 

.17 

17 

1130 

1230 

.17 

18 

1130 

1230 

.17 

19 

1400 

1500 

2.50 

20 

1400 

1500 

2.50 

21 

1415 

1515 

.25 

22 

1415 

1515 

.25 

23 

1430 

1530 

.25 

24 

1430 

1530 

.25 
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These  24  interarrival  times  were  then  used  to  obtain 
condescriptive  statistics  and  histograms.  A  chi-square  GOF 
test  was  applied  and  the  null  hypothesis  that  the  interar¬ 
rival  times  are  exponentially  distributed  could  not  be 
rejected.  The  parameters  of  this  distribution  are  a  mean 
of  0.543  hours,  a  minimum  of  0.0  hours,  and  a  maximum  of  2.5 
hours  (see  Appendix  Cl). 

Probability  Distributions .  The  maintenance  action 
taken  data  was  extracted  from  the  F-16  CDS  for  MacDill  AFB, 
Florida  during  the  period  of  1  February  1982  through  31  Jan¬ 
uary  1983.  Work  unit  code  74ABO  was  used  to  specify  the 
LPRF  in  this  extraction  process.  The  following  maintenance 
action  probability  distribution  analysis  was  performed. 

H  action  takens  represent  the  time  required  to  CND 
an  LPRF  write-up.  Our  statistical  analysis,  which  Includes 
condescriptive  statistics,  a  histogram,  and  a  chi-square 
goodness-of-fit  on  the  data  resulted  in  H  actions  being  expo¬ 
nentially  distributed  with  a  mean  of  4.858  hours,  a  minimum 
of  1.0  hour,  and  a  maximum  of  30. 0  hours  (see  Appendix  C2). 

P  action  takens  represent  the  time  to  remove  an  LPRF 
from  the  aircraft.  Condescriptive  statistics,  a  histogram, 
and  a  chi-square  goodness-of-fit  test  on  the  data  points 
indicate  P  actions  to  be  exponentially  distributed  with  a 
mean  of  4.504  hours,  a  minimum  of  0.5  hour,  and  a  maximum  of 
25.0  hours  (see  Appendix  C3). 


29 


f 


Q  action  takens  represent  the  time  to  install  an 
LPRF  in  the  aircraft.  Condescriptive  statistics,  a  histo¬ 
gram,  and  a  chi-square  goodness-of-fit  test  resulted  in  Q 
actions  being  exponentially  distributed  with  a  mean  of  4.45 
hours,  a  minimum  of  1.0  hour,  and  a  maximum  of  20.0  hours 
(see  Appendix  C4). 

R  action  takens  represent  the  time  to  remove  and 
replace  an  LPRF  on  the  aircraft.  Condescriptive  statistics, 
a  histogram,  and  a  chi-square  goodness-of-fit  test  indicate 
that  R  actions  are  exponentially  distributed  with  a  mean  of 
5.115  hours,  a  minimum  of  1.0  hour,  and  a  maximum  of  28.0 
hours  (see  Appendix  C5). 

A  action  takens  represent  the  time  to  bench  check  an 
LPRF  when  repair  of  the  LPRF  is  required.  Condescriptive 
statistics,  a  histogram,  and  a  chi-square  goodness-of-fit 
test  resulted  in  A  actions  being  exponentially  distributed 
with  a  mean  of  12.503  hours,  a  minimum  of  0.4  hour,  and  a 
maximum  of  101.4  hours  (see  Appendix  C6). 

3  action  takens  represent  the  time  to  bench  check  an 
LPRF  when  no  repair  is  required.  This  indicates  a  RTOK  con¬ 
dition.  Condescriptive  statistics,  a  histogram,  and  a 
goodness-of-fit  test  indicate  that  B  actions  are  exponen¬ 
tially  distributed  with  a  mean  of  7.212  hours,  a  minimum  of 
1.0  hour,  and  a  maximum  of  61.0  hours  (see  Appendix  C7 ) . 

The  1  action  takens  represent  time  to  test  the  LPRF 
when  repair  is  beyond  the  base  capability.  This  is  a  NRTS 
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condition.  Condescriptive  statistics,  a  histogram,  and  a 
chi-square  goodness-of-fit  test  resulted  in  1  actions  being 
exponentially  distributed  with  a  mean  of  5.243  hours,  a  mini¬ 
mum  of  0.5  hour,  and  a  maximum  of  25.7  hours  (see  Appendix 
C8 ) . 


Branching  Probabilities.  Q-GERT  model  networks  rely 
on  probabilistic  branching  to  route  transactions  over  alter¬ 
native  activity  paths  (Pritsker,  1979).  Our  model's  branch¬ 
ing  coefficients  were  estimated  from  the  CDS  data.  First, 
the  number  of  actions  for  each  maintenance  code  (P,  R,  H,  B, 
A,  and  1)  were  computed,  followed  by  a  ratio  of  the  particu¬ 
lar  maintenance  category  to  the  appropriate  totals.  For 
example,  of  the  686  intermediate  level  maintenance  actions 
(3,  A,  and  1),  291  were  RTOK  (B).  This  represents  a  .42 
probability  coefficient  in  the  model.  See  Table  II  for  all 
maintenance  categories  and  their  associated  probability  coef¬ 
ficients  . 

The  F-16  SPO  and  HQ  TAC/Avionics  provided  the  follow¬ 
ing  data  for  MacDill  AFB:  (1)  LRU  transit  time  from  the 
flightline  to  the  AIS  is  approximately  2.0  hours;  (2)  LRU 
transit  time  from  the  base  to  Depot  and  back  for  repair  is 
approximately  48.0  hours;  (3)  transit  time  of  serviceable 
LRUs  to  Base  Supply  is  approximately  0.1  hour;  (4)  the  num¬ 
ber  of  AIS  test  stations  assigned  are  2;  (5)  the  number  of 
flightline  maintenance  personnel  are  2;  (6)  the  number  of 
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Table  2 


Branching  Probabilities 


Branch  Action  Code  #  of  Actions  Probability 

Troubleshoot 
(T-Shoot)  to 


Removal 

P 

24 

.17 

T-Shoot  to 

Remove  and 

Replace  (R&R) 

R 

116 

.83 

Total 

140 

1.00 

Flight  line 

Action  to  CND 

H 

50 

.26 

Flightline 

Action  to  T-Shoot 

(P, 

R,  &  L) 

140 

.74 

Total 

190 

1.00 

Bench  Check 

No  Repair  (RTOK) 

B 

291 

.42 

Bench  Check  and 
Repair  (BCRP) 

A 

349 

.51 

Not  Repairable 

This  Station 
(NRTS ) 

1 

46 

.07 

Total 

686 

1.00 
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intermediate  level  maintenance  personnel  are  2;  and 
(7)  approximately  30  percent  of  all  arriving  aircraft  will 
require  maintenance  action  on  the  LPRF  (Caracilla,  1983; 
Stacey,  1983). 

Depot  repair  time  of  the  F-16  radar  was  estimated 
to  be  lognormal  with  a  mean  of  14.0  hours  and  a  standard 
deviation  of  11. 91  hours  (Bryson,  Husby  &  Webb,  1982).  Fur¬ 
ther  confirmation  of  this  data  for  calendar  year  1982  was 
through  personnel  at  HQ  AFLC/Analysis  and  Support  Division 
(Newman,  1983). 

Table  III  summarizes  all  the  estimated  parameters, 
probability  distributions,  and  decision  point  variables 
represented  by  the  F-16  LPRF  maintenance  diagnostic  process. 

The  Q-GERT  Model 

All  of  the  probability  distributions,  decision  point 
coefficients,  assumptions,  and  logic  have  now  been  estab¬ 
lished.  A  Q-GERT  model  can  now  be  developed  which  integrates 
all  of  these  factors  and  simulates  the  maintenance  process. 
Figure  5  is  an  overview  of  the  entire  model  using  standard 
Q-GERT  symbology.  (For  a  complete  description  of  Q-GERT 
symbology,  see  Appendix  A.) 

The  model  simulates  the  repair  cycle  process  at 
MacDill  AFB,  Florida  and  the  depot  repair  facility  located 
at  Hill  AFB,  Utah.  For  ease  of  explanation,  the  model  is 
further  sub-divided  Into  functional  areas. 
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Model  Parameters 
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Figure  5.  Q-GERT  simulation  model  of  F-l6  LPRF  maintenance  repair  process 


Figure  6  indicates  the  generation  of  aircraft 
arrivals  for  beginning  the  simulation.  At  node  1,  2000 
arrivals  are  incremented  one  at  a  time,  from  an  exponential 
distribution  using  parameter  set  1  (see  legend.  Figure  5). 

The  arriving  aircraft  is  then  routed  for  action 
determination  (see  Figure  7).  At  node  2,  the  aircraft  is 
probabilistically  branched  to  require  action  on  the  LPRF 
(0.30)  or  so  that  no  action  is  required  (0.70).  Aircraft 
requiring  no  action  are  sent  to  node  40,  where  the  aircraft 
is  considered  OR  for  the  LPRF.  The  aircraft  requiring  action 
travels  to  node  3  where  it  is  held  for  flightline  action. 

Next,  the  aircraft  is  routed  to  node  4  when  one  of 
the  two  servers  are  available  to  perform  flightline  action 
(see  Figure  3).  Node  4  provides  probabilistic  branching  for 
aircraft  requiring  troubleshooting  (0.74)  and  LPRF  action 
requirements  which  cannot  be  duplicated  (0.26).  Aircraft 
CMD'd  are  sent  to  node  6  using  an  exponential  distribution 
with  parameter  set  2  (see  legend.  Figure  5).  The  aircraft 
is  then  routed  to  node  40  where  the  number  of  OR  aircraft 
is  incremented  by  1. 

The  aircraft  requiring  troubleshooting  is  then  sent 
to  node  5  where  it  is  branched  probabilistically  for  LPRF 
removal  (0.17)  or  removal  and  immediate  replacement  with  a 
serviceable  LPRF  (0.83)(see  Figure  9). 

The  removed  LPRF  is  routed  to  node  7  where  a  constant 
attribute  value  of  2  is  assigned  for  indication  of  repair 
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Figure  8.  Flightline  action  determination. 
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priority  at  the  AIS  test  station  and  routing  back  for  instal¬ 
lation  in  the  aircraft.  The  LPRF  is  then  sent  to  node  8 
using  an  exponential  distribution  with  parameter  set  3  (see 
legend,  Figure  5)  which  simulates  the  time  required  to 
remove  the  LPRF  from  the  aircraft.  The  LPRF  then  travels 
from  node  8  to  node  9  at  a  constant  2  hour  rate  to  account 
for  transit  time  of  the  LPRF  to  the  AIS.  Node  9  holds  the 
removed  LPRF  until  a  station  is  available  to  repair  the  LPRF. 

If  the  LPRF  is  to  be  removed  and  immediately  replaced 
with  a  new  LPRF,  the  aircraft  is  routed  from  node  5  to  node 
10  where  a  constant  attribute  value  of  3  is  assigned  for 
repair  prioritization.  The  aircraft  then  moves  to  node  11 
to  await  a  serviceable  LPRF  to  complete  the  removal  and 
replacement  action. 

The  remove  and  replace  action  is  accomplished  when 
two  conditions  are  satisfied  (see  Figure  10).  First,  an  air¬ 
craft  transaction  is  waiting  at  node  11  and  secondly,  a 
serviceable  LPRF  is  available  at  node  25,  the  flightline 
supply  queue.  When  both  conditions  are  satisfied,  selector 
node  12  assembles  the  transactions  and  routes  them  to  node 
13  using  an  exponential  distribution  with  parameter  set  4 
(see  legend,  Figure  5).  This  simulates  the  time  required  to 
remove  and  replace  the  LPRF  on  the  aircraft.  The  repaired 
aircraft  is  sent  to  node  4o  and  Increments  the  number  of  OR 
aircraft  by  1.  The  removed,  unserviceable  LPRF  moves  to 
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node  14,  where  it  is  held  awaiting  an  AIS  test  station  for 
repair . 

The  blocked  selection  node  15  establishes  a  pre¬ 
ferred  order  for  repair  of  LPRFs  by  the  two  available  test 
stations  (see  Figure  11).  Preferred  treatment  is  given  to 
the  removed  LPRFs  waiting  at  node  9.  If  no  transactions  are 
waiting  at  node  9,  LPRFs  removed  during  a  removal  and 
replacement  action  at  node  14  are  routed  for  repair  when  a 
server  is  available.  LPRFs  are  sent  from  node  15  to  node  16 
for  AIS  repair. 

LPRFs  at  node  16  are  probabilistically  branched  to 
one  of  three  test  actions  (see  Figure  12).  First,  the  LPRF 
might  be  bench  checked  with  no  repair  required  or  RTOK 
(0.42).  The  LPRF  is  routed  to  node  17  using  an  exponential 
distribution  with  parameter  set  5  (see  legend,  Figure  5). 

This  simulates  the  time  to  bench  check  an  LPRF  with  no 
repair.  The  LPRF  then  moves  to  the  conditional  branching 
node  20  for  action. 

Secondly,  the  LPRF  might  be  bench  checked  and  require 
repair  (0.51).  The  LPRF  is  routed  from  node  16  to  node  18 
using  an  exponential  distribution  with  parameter  set  6  (see 
legend.  Figure  5).  This  simulates  the  time  to  bench  check 
and  repair  an  LPRF.  The  LPRF  is  then  sent  to  the  conditional 
branching  node  20  for  action. 


Finally,  the  LPRF  might  be  tested  and  determined  to 
be  beyond  the  base's  capability  to  repair  the  LPRF  (0.07). 


Figure  11.  AIS 


The  LPRF  is  routed  from  node  16  to  node  19  for  NRTS  action 
using  an  exponential  distribution  with  a  parameter  set  7 
(see  legend.  Figure  5).  The  LPRF  then  moves  to  the  condi¬ 
tional  branching  node  20  for  action  and  to  node  29,  depot, 
at  a  constant  of  48.0  hours  for  repair. 

Node  20  conditionally  branches  the  LPRF  depending 
upon  attribute  value  assigned  during  removal.  LPRFs  with  an 
AT2  value  of  2  are  routed  to  node  22  for  installation  on  an 
aircraft.  LPRFs  with  an  AT2  value  of  3  are  sent  to  node  21, 
the  Base  Supply  queue. 

LPRFs  requiring  installation  on  an  aircraft  are 
routed  from  node  22  to  node  23  using  an  exponential  distri¬ 
bution  with  parameter  set  8  (see  legend.  Figure  5)  (see  Figure 
13).  This  simulates  the  time  to  install  an  LPRF  on  the  air¬ 
craft.  The  repaired  aircraft  moves  to  node  40  where  the 
number  of  OR  aircraft  is  incremented  by  1. 

Serviceable  LPRFs  are  routed  from  depot,  node  24,  to 
node  21  using  a  lognormal  distribution  with  parameter  set  9 
(see  legend.  Figure  5).  This  simulates  the  time  to  repair 
an  LPRF  at  depot  (see  Figure  14).  LPRFs  are  sent  from  node 
21  to  the  flightline  supply  queue  node  25  at  a  constant  rate 
of  0.1  hours . 

Experimental  Design 

The  experimental  design  of  a  computer  simulation  is 
important  for  two  major  re  ''ns.  First,  the  simulation  must 
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be  an  effective  tool  for  learning  as  much  as  possible  about 
the  modeled  system '  s  behavioral  characteristics.  Second,  the 
design  must  consider  efficiency,  as  computer  time  is  expen¬ 
sive.  Shannon  (1975,  pp .  144-152)  discusses  the  experimental 
design  of  simulations  with  these  points  in  mind.  We  will 
use  his  suggestions  in  our  attempt  to  develop  an  effective 
and  efficient  model. 

Simulation  models,  in  general,  study  the  response 
of  the  dependent  variable(s)  as  the  independent  variable(s) 
change.  Our  response  (dependent)  variable  will  be  the  time 
required  to  achieve  operational  readiness.  Many  possibili¬ 
ties  exist  in  factors  which  might  influence  the  response 
variable.  Incorporating  all  of  them  into  a  simulation  model 
would  be  impossible.  According  to  the  Pareto  principle, 
there  are  a  few  significant  factors  which,  in  terms  of  per¬ 
formance  and  effectiveness,  account  for  a  large  majority  of 
the  relationship  (Shannon,  1975,  pp.  153,154).  Therefore, 
our  simulation  considers  only  the  significant  contributing 
factors  in  its  design.  These  model  variables  are  discussed 
next . 

Table  IV  specifies  the  independent  and  dependent 
variables  of  our  model.  Further  classification  of  the  inde¬ 
pendent  variables  is  by  controlled,  stochastic,  and  constant 
status.  Controlled  variables  are  those  that  are  measured  and 
varied  in  the  experiment  to  determine  the  effect  on  the  depen¬ 
dent  variable.  Stochastic  variables  vary  with  respect  to  the 
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Controlled 


CND  Rate 

RTOK  Rate 

CND/RTOK  Rate 
( Combined ) 


Table  4 

M'-'del  Variables 


Independent 

Stochastic  Constant 

Maintenance  Times  #  of  Technicians 

(Servers ) 

Interarrival  Times  *  of  AIS  Test 

Stations 

j^Isirt 0r«S!icc  Aoc-i.o>’''  **  Spsi^c 

Frobabil i t ies  Transit  Times 


sampling  distributions  they  are  drawn  from.  Finally,  con¬ 
stant  variables  do  not  vary  so  that  experimental  cause  and 
effect  relationships  can  be  more  easily  determined. 

In  summary,  our  model  studies  the  effect  of  varying 
the  CND,  RTOK,  and  combined  CND/RTOK  rates  on  the  time 
required  to  achieve  operational  readiness.  The  manner  in 
which  these  controlled  variables  were  changed  in  the  experi¬ 
ment  is  included  in  the  sensitivity  analysis  section.  The 
next  consideration,  efficiency  of  the  computer  simulation, 
begins  with  determination  of  the  number  of  factors  which 
will  be  varied  in  the  model  and  at  how  many  levels  these 
factors  will  be  allowed  to  vary.  Then,  the  number  of  com¬ 
puter  runs  necessary  to  generate  enough  data  for  adequate 
analysis  can  be  determined. 

Our  model  examines  three  controlled  variables  which 
will  be  varied  over  an  appropriate  range  of  interest.  Since 
we  are  concerned  'with  the  effect  of  increased  BIT  and  ATE 
efficiency,  and  have  determined  that  present  capabilities 
are  inadequate,  our  range  of  interest  begins  with  the  present 
base  level  of  CND  and  RTOK  rates.  Then,  these  rates  are 
reduced  by  one-third  and  two-thirds  resulting  in  a  total  of 
three  levels  for  each  category.  Therefore,  our  experimental 
design  consists  of  three  factors  with  three  levels  each.  The 
number  of  computer  runs  is  then  computed  using  the  following 
f  cnmu 1  a : 
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where 


number 

of 

factors  (3) 

number 

of 

factor  levels 

(3) 

number 

of 

replications 

(1) 

number 

of 

computer  runs 

required 

(Shannon,  1975,  p.  156) 

Substituting,  we  arrive  at  the  number  of  computer  runs 
required  to  be  27. 

We  are  confident  that  we  have  included  the  signifi¬ 
cant  elements  of  the  LPRF  maintenance  diagnostic  process  in 
our  simulation  model.  Recognition  of  the  experimental  design 
criteria  of  effectiveness  and  efficiency  will  help  in  the 
study  of  this  system's  behavior  under  controlled  conditions. 

Phase  III:  Computerisation 
Computer  Program  (Q-1SRT) 

A  computer  listing  of  the  3-1ERT  program  we  developed 
from  the  structural  ard  parametric  models  is  included  in 
Appendix  D. 


Model  Validation 

The  model's  validity  is  .'uiooi  in.  two  respects. 

First,  we  will  verify  the  st  nurture  an  3  1  '  -*  i  c  of  the  model 
along  with  its  internal  data.  We  call  “hie  phase  design 
validity.  Next ,  the  model's  behavior  ic  compare  5  to  the 
modeled  system's  actual  behavior.  This  is  centrally  referred 
to  as  external  validity. 


Design  Validity.  The  design  validity  phase  consists 


of  two  steps.  First,  internal  traces  of  the  model's  trans¬ 
actions  show  that  the  structure  and  logic  are  sound.  Trans¬ 
action  passages  follow  the  incoming  sortie  through  the  model's 
structure  and  show  that  the  sortie  behaves  according  to  plan. 
This  internal  trace  allows  verification  of  appropriate  logic 
flow.  Modal  traces  reveal  the  times,  nodes,  and  transaction 
routings  taken  throughout  the  model.  An  example  of  these 
traces  is  shown  in  Appendix  El.  Transaction  passage  documen¬ 
tation  verifies  that  appropriate  branching  probabilities  are 
present  (see  Appendix  E2).  In  the  second  step,  the  model's 
internal  data  is  verified  with  the  application  of  GOF  tests 
to  all  O-GERT  generated  probability  distributions.  Appendix 
F  reflects  the  condescriptive  data,  histograms,  and  GOF  tests 
for  the  nine  Q-GERT  generated  distributions.  These  tests  and 
associated  results  indicate  that  the  Q-GERT  distributions  are 
all  representative  of  the  parametric  data  initially  modeled. 

External  Validity.  Confidence  in  our  model's  repre¬ 
sentativeness  is  based  upon  the  valid  inpu'’  and  recommenda¬ 
tions  of  personnel  at  HQ  TAC/ Avionics ,  HQ  AFLC/Analysls  and 
Support,  the  F-16  SPO,  and  our  own  previous  avionics  mainte¬ 
nance  experience.  A  telephone  interview  with  the  F-16  avi¬ 
onics  officer  at  HQ  TAC  provided  initial  Input  for  the 
model's  structural  design  (Stacey,  1983).  Personal  inter¬ 
views  with  the  F-16  SPO  Data  Analysis  Division  Branch  Chief 
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confirmed  the  appropriateness  of  the  proposed  maintenance 

process  model  (Caracillo,  1983).  In  addition,  a  personal 

Interview  with  a  research  analyst  familiar  with  Q-GERT 

modeling  of  the  F-16  diagnostic  process  confirmed  our  model's 

validity  (King,  1983).  Shannon  (1975)  states: 

If  the  results  are  reasonable,  if  they  appear  to  fit 
our  previous  experiences,  then  we  tend  to  minimize 
concerns  about  the  .  .  .  way  in  which  the  study  was 
conducted.  On  the  other  hand,  if  the  results  or 
recommendations  do  not  make  sense,  all  the  statistical 
tests  and  analyses  ever  devised  will  not  convince  the 
decision  maker  to  accept  them.  (p.  237) 

We  are  highly  confident  that  our  model  and  its  results  "make 

sense"  and,  therefore,  adequately  reflect  the  actual  F-16 

radar  maintenance  diagnostic  process. 


Findings 

Simulation  Output 

Based  upon  the  preceding  development  of  structural, 
parametric,  and  computerization  models,  the  Q-GERT  program 
was  run  using  the  baseline  CNF  and  RTOK  rates.  A  summary  of 
27  observations  of  total  time  required  to  generate  2,000  OR 
aircraft  is  presented  in  Appendix  G.  The  mean  time  to  gen¬ 
erate  2,000  OR  aircraft  in  the  baseline  simulation  was 
9317.-48  hours,  with  a  standard  deviation  of  279.37  hours. 
These  data  points  were  used  as  a  reference  for  the  sensitiv¬ 
ity  analysis  phase,  discussed  next. 

Sensitivity  Analysis 

Procedure .  Our  previously  defined  range  of  interest 
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begins  with  the  base  CND  and  RTOK  rates.  We  then  decrease 
these  rates  (which  reflect  increased  BIT  and  ATE  capabili¬ 
ties)  by  one-third  and  then  two-thirds.  Corresponding  to 
each  of  these  reductions  is  a  .similar  reduction  of  the  main¬ 
tenance  action/no  action  branch  probabilities.  (As  the  CND 
or  RTOK  rate  is  decreased,  the  action  branch  is  decreased 
due  to  a  reduced  requirement  for  maintenance  activities.) 

Table  V  shows  the  model's  CND  and  Action/No-Action  coeffi¬ 
cients  at  the  three  levels.  Table  VI  shows  the  model  coef¬ 
ficients  for  RTOK  sensitivity  analysis.  Finally,  Table  VII 
shows  the  combined  CND/RTOK  model  coefficients  as  these  rates 
are  reduced  simultaneously. 

Results .  Table  VIII  is  a  summary  of  the  results  of 
our  sensitivity  analysis  phase.  (See  Appendix  G  for  a  break¬ 
down  of  each  model  run. )  Initial  observation  of  these  results 
seems  to  indicate  that  the  mean  time  to  F-16  aircraft  avail¬ 
ability  does  not  decrease  significantly  for  CND  reduction. 
However,  RTOK  and  combined  CND/RTOK  reductions  appear  to  sig¬ 
nificantly  affect  the  time  to  OR.  Further  statistical  anal¬ 
ysis  of  the  significance  of  these  results  is  presented  in  the 
next  section. 

Significance  Tests.  Statistical  significance  of 
results  will  be  performed  in  two  stages.  rirst,  the  applica¬ 
bility  of  parametric  analysis  of  results  is  determined  with 
the  Homogeneity  of  Variance  test.  Then,  an  examination  of 
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Table  5 


CND  Sensitivity  Analysis 


CND 

T-Shoot 

Action 

No  Action 

Easeline 

.26 

.74 

.30 

.70 

Decrease 

1/3 

•  19 

.81 

.27 

.73 

Decrease 

2/3 

.  10 

.90 

.24 

.76 

Table  6 

RTOK  Sensitivity  Analysis 


RTOK 

BCRP 

NRTS 

Action 

No  Action 

Baseline 

.  42 

.51 

.07 

.30 

.70 

Decrease 

1/3 

•  32 

.59 

.09 

.27 

.73 

Decrease 

2/3 

.  19 

.71 

.  10 

.23 

.77 
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Table  8 


Sensitivity  Analysis  Results 


Mean 

Std  Dev 

CDN  Actions 

Baseline 

if 3 17  •  48 

279.37 

1/3  reduction 

4257 . 16 

274.48 

2/3  reduction 

4239.6? 

253.59 

RTOK  Actions 

Baseline 

4317.48 

279.37 

1/3  reduction 

3971.50 

283.96 

2/3  reduction 

3611. 45 

293.06 

Combined  CND/RTOK  Actions 

Baseline 

4317.48 

279.37 

1/3  reduction 

3793.28 

217.87 

2/3  reduction 

3214.95 

255.09 
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the  difference  in  means  via  Duncan's  Multiple  Range  and  One- 
Way  ANOVA  tests  provides  a  method  of  determining  whether  the 
sensitivity  analysis  results  are  significant  (Bartee,  1968). 

The  Homogeneity  of  Variances  tests  of  the  response 
surfaces  are  presented  in  Appendices  H1-H3.  Results  of  these 
tests  indicate  equality  of  variance  in  all  cases.  Therefore, 
Duncan's  Multiple  Range  and  ANOVA  tests  can  be  used  to  test 
significance . 

The  Duncan  procedure  was  applied  to  the  CND  sensi¬ 
tivity  analysis  data.  The  null  hypothesis,  which  stated 
the  means  of  the  baseline,  one-third,  and  two-thirds  reduc¬ 
tion  in  CND  rate  were  equal,  could  not  be  rejected.  The 
One-Way  ANOVA  test  results  were  the  same.  Therefore,  these 
tests  confirm  our  initial  observation  that  CND  reductions 
do  not  significantly  reduce  time  to  aircraft  OR  (see  Appendix 
H  9 ) . 

RTOK  sensitivity  analysis  data,  when  tested  with 
Duncan's  Multiple  Range  and  One-Way  ANOVA  tests,  indicates 
the  null  hypothesis  of  equal  means  can  be  rejected.  Again, 
our  initial  suspicion  that  decreased  RTOK  rates  significantly 
affected  aircraft  OR  time  is  confirmed  (for  both  one-third 
and  two-thirds  reductions).  (See  Appendix  H5 . ) 

Finally,  the  testing  of  the  combined  CND/RTOK  sensi¬ 
tivity  analysis  data  shows  that  the  difference  in  means  is 
significant  for  both  the  Duncan's  and  ANOVA  tests.  Appendix 
H6  displays  the  appropriate  test  and  results. 


60 


Summary 

This  chapter  showed  the  findings  of  our  thesis  as 
related  to  the  hierarchy  of  the  Systems  Science  Paradigm.. 
First,  the  conceptualization  phase,  consisting  of  a  clear 
statement  of  the  purpose  and  a  structural  model  of  the  sys¬ 
tem,  was  discussed.  Second,  the  analysis  and  measurement 
phase  related  the  parametric  model  development  and  the 
experimental  design.  Third,  we  presented  the  computeriza¬ 
tion  phase  which  included  the  Q-GERT  computer  program  list¬ 
ing,  model  validation,  and  simulation  output,  including  sensi¬ 
tivity  analysis.  The  next  chapter  will  draw  conclusions  from 
these  findings  and  suggest  recommendations  for  further 
research . 
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CHAPTER  IV 


CONCLUSIONS  AND  RECOMMENDATIONS 

This  study  has  examined  the  problem  of  increased 
diagnostic  error  rates  in  complex  weapon  systems.  Specifi¬ 
cally,  the  F-16  radar  LPRF  LRU  maintenance  diagnostic  process 
was  modeled  using  a  Q-GERT  simulation  program.  The  results 
of  this  simulation  as  reported  in  Chapter  III  showed  how  CND, 
RTOK,  and  combined  CND/RTOK  rates  affect  F-16  aircraft  avail¬ 
ability.  Our  research  questions  can  now  be  answered  with 
regard  to  the  simulation  results. 

Conclusions 

Research  Question  #1 

Can  a  queueing  simulation  model  of  the  F-16  radar 
LPRF  maintenance  diagnostic  process  be  developed  using 
estimated  probability  distributions  and  descriptive  param¬ 
eters  for  test  and  repair  times  and  decision  point  variables? 

We  demonstrated  the  potential  of  using  the  CDS  for 
data  extraction  and  developing  probability  distributions. 
These  distributions  and  their  descriptive  parameters  are  des¬ 
cribed  in  Appendix  B.  Other  parametric  information  was 
obtained  from  the  F-16  SPO,  HQ  TAC/Avionics ,  and  HQ  AFLC. 
Incorporating  this  parametric  information  in  a  Q-GERT  simu¬ 
lation  model  was  accomplished  successfully.  The  design 
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validity  of  this  model  shows  that  Q-GERT  generated  param¬ 
eters  and  distributions  adequately  reflect  the  original  data. 
Therefore,  a  Q-GERT  model  can  be  developed  for  the  F-16 
radar  LPRF  maintenance  process  with  existing  data. 

Research  Question  #2 

Can  sensitivity  analysis  of  key  decision  variables 
be  used  to  determine  the  effects  of  CND  and  RTOK  rates  on 
F-16  aircraft  availability? 

The  Duncan's  Multiple  Range  and  One-Way  ANOVA  tests, 
as  reported  in  Appendix  H,  show  how  statistically  signifi¬ 
cant  are  the  sensitivity  analysis  results  of  CND,  RTOK,  and 
combined  CMD/RTOK  rate  variations.  CND  rate  changes  do  not 
significantly  decrease  the  time  to  aircraft  OR.  However, 
both  RTOK  and  combined  CND/RTOK  rate  changes  are  statisti¬ 
cally  significant.  Sensitivity  analysis  of  the  key  decision 
variables  in  our  model  demonstrates  the  effects  of  reduced 
CND,  RTOK,  and  combined  CND/RTOK  rates  on  F-l6  aircraft 
availability  (as  aircraft  availability  is  related  to  time 
required  to  OR).  Our  conclusions  with  regard  to  this 
research  question  are  that  increased  emphasis  on  improved 
ATE  capability  at  the  I-level  or  a  combined  improvement  of 
BIT  and  ATE  capabilities  will  reduce  the  time  required  to 
generate  OR  F-l6  aircraft. 

Recommendations 

As  a  central  source  for  data  extraction  and  analysis 
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the  CDS  is  a  valuable  tool.  The  real  time,  on-line  charac¬ 
teristics  of  this  system  provide  logistics  managers  with 
timely  knowledge  of  most  of  the  maintenance  information 
required  for  effective  decision  making.  Therefore,  we  recom¬ 
mend  the  application  of  a  CDS  type  data  bank  to  other  weapon 
systems.  Furthermore,  F-16  logistics  managers  should  become 
intimately  familiar  with  the  CDS  and  require  its  inclusion 
in  all  applicable  maintenance  management  decisions. 

Regarding  the  results  of  our  simulation  output,  we 
recommend  additional  emphasis  toward  improving  F-16  ATE  and 
BIT  diagnostic  equipment  and/or  procedures.  Since  our  simu¬ 
lation  results  showed  that  CMD  reductions  alone  do  not  sig¬ 
nificantly  decrease  the  time  to  aircraft  OR,  we  recommend 
that  emphasis  be  placed  on  improving  the  effectiveness  of 
both  the  O-level  BIT  equipment  and  the  I-level  ATE.  In 
addition  to  these  improvements,  the  maintenance  technician 
training  programs  should  also  be  updated  to  keep  up  with  the 
increased  sophistication  of  the  equipment.  Obviously,  the 
design  of  the  new  equipment  and  procedures  should  consider 
the  available  skill  levels  and  training  capabilities  of  0 
and  I-level  personnel. 

Recommendations  for  Further  Research 

We  considered  the  following  areas  during  our  thesis 
project  which  may  require  further  study.  Another  weapon  sys¬ 
tem  component  which  exhibits  high  diagnostic  error 


characteristics  could  be  modeled  to  determine  the  generaliz- 
abillty  of  this  research  project.  Also,  the  present  model, 
in  a  revised  state,  may  be  used  to  analyze  the  effects  of 
reduced  error  rates  on  maintenance  man-hours  expended. 
Further  research  in  all  areas  of  maintenance  diagnostics  is 
encouraged . 


Summary 

In  conclusion,  we  developed  a  Q-GERT  simulation  model 
through  the  application  of  the  Systems  Science  Paradigm  to 
the  problem  of  increased  automatic  testing  errors  in  avionics 
equipment.  The  model  represented  the  F-16  L?RF  maintenance 
process  and  attempted  to  discover  what  effect  reduced  CND 
and  RTOK  rates  would  have  on  F-16  aircraft  availability.  The 
computer  results  showed  that  decreased  CND  rates  did  not  sig¬ 
nificantly  affect  the  time  required  for  aircraft  OR.  How¬ 
ever,  when  combined  with  RTOK  rate  reductions,  reduced  CMC 
rates  did  decrease  OR  time.  RTOK  rate  reductions  alone  had 
a  significant  effect  in  reducing  the  time  to  aircraft  OR. 
Therefore,  we  concluded  that  increased  emphasis  in  the  areas 
of  BIT  and  ATE  accuracy  with  regard  to  F-16  avionics  is  justi 
fled.  Further  recommendations  included  increased  use  of  the 
CDS  by  logistics  managers  and  development  of  a  CDS  type  data 
base  for  other  weapon  systems.  If  the  recommendations  for 
further  research  are  accomplished,  the  general inability  of 
this  simulation  project  will  be  enhanced. 
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This  appendix  lists  the  commonly  used  abbreviations 
or  acronyms  involved  with  the  logistics  support  of  the' P-16 
weapon  system  and  queueing  theory  terminology.  Also 
included  in  this  appendix  is  the  symbology — giving  the  com¬ 
monly  used  statistical  symbols  and  the  Q-GERT  symbology  used 
in  the  Q-GERT  simulation  model. 


Abbreviations  and  Acronyms 

A/C  Aircraft 

APB  Air  Force  Base 

AFHRL  Air  Force  Human  Resources  Laboratory 

AFLC  Air  Force  Logistics  Command 

ATS  Automatic  Intermediate  Shop 

AMOVA  Analysis  of  Variance 

ATE  Automatic  Test  Equipment 

B/C  Bench  Check 


3CRP 


Bench  Check  and  Repair 
Built-in- Test 


BITE 

CDS 


npv 


GO" 


Built-in-Test  Equipment 
Centralized  Data  System 
Cannot-Duplicate 
Critical  Path  Method 
Gooiness-o f -Fit 
Headquarters 
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I-LEVEL 


Intermediate  Level 


I  AT 

INS 

LPRF 

LRU 

NRTS 

O-LEVEL 

OR 

PERT 

PR03 

Q-GSRT 

R&R 

RADC 

RTOK 

3?0 

SPSS 

ST 

T-Shcot 

TAG 

TFTW 


Interarrival  Time 
Inertial  Navigation  System 
Low  Power  Radio  Frequency 
Line  Replaceable  Unit 
Not  Repairable  This  Station 
Organizational  Level 
Operationally  Ready 

Program  Evaluation  Review  Technique 
Probability 

Queueing-Graphical  Evaluation  and  Review 
Technique 

Remove  and  Replace 
Rome  Air  Development  Center 
Retest-0K/3ench  Check-No  Repair  Required 
Systems  Program  Office 

Statistical  Package  for  the  Social  Science 

Self  Test 

Troubleshoot 

Tactical  Air  Command 

Tactical  Fighter  Training  Wing 


Alternative  Hypothesis 
Null  -Hypothesis 
Number  of  Cases 
Alpha  Value 
Greater  Than 
Less  Than 


is  the  number  of  incoming  transactions 
required  to  release  the  node  for  the  first 
time . 

R,,  is  the  number  of  incoming  transactions 
required  to  release  the  node  for  all  subse¬ 
quent  times. 

C  is  the  criterion  for  holding  the  attribute 
set  at  a  node. 

S  is  the  statistics  collection  type  or  mark¬ 
ing. 

#  is  the  node  number. 


r\ 

indicates  deterministic  branching  from 
the  node. 

Ls 


indicates 
the  node. 


probabilistic 


branching 


from 


I  is  the  initial  number  of  transactions  at 
the  Q-node. 


M  is  the  maximum  number  of  transactions  per¬ 
mitted  at  the  Q-node. 

R  is  the  ranking  procedure  for  ordering  tran 
actions  at  the  Q-node. 

*  is  the  Q-node  number. 
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Symbols  -  Continued 


vW  ■  —>  Pointer  to  a  source  node  or  from  a  sink  node. 


(P) (D,?S) 

□  0 


P  is  the  probability  of  taking  the  activity 
(only  used  if  probabilistic  branching  from 
the  start  -node  of  the  activity  is  specified). 

D  is  the  distribution  or  function  type  from 
which  the  activity  time  is  to  be  determined. 

PS  is  the  parameter  set  number  (or  constant 
value)  where  the  parameters  for  the  activity 
time  are  specified. 

U  is  the  activity  number 

N  is  the  number  of  parallel  servers  associ¬ 
ated  with  the  activity  (only  used  if  the 
start  node  of  the  activity  is  a  Q-node). 


Concept:  Value  Assignment 


A  is  the  attribute  number  to  which  a  value  is 
to  be  assigned;  if  A+  is  specified,  add  value 
to  attribute  A;  if  A-  is  specified,  subtract 
value  from  attribute  A. 


D  is  the  distribution  or  function  type  from 
which  assignment  value  is  to  be  determined. 


PS  is  the  parameter  set  number. 


Concept:  Queue  Ranking 

R  is  the  ranking  procedure  for  ordering 
transactions  at  the  Q-node.  R  can  be  speci¬ 
fied  as:  F  -  FIFO;  L  -  LIFO;  B/i  -  Big 
value  of  attribute  i;  S/i  -+  Small  value  of 
attribute  i.  If  i  =  M,  ranking  is  based  on 
mark  time. 


Concept:  Conditional,  Take-First 


□indicates  conditional-take 
branching  from  the  node. 


Branching 

first 
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Symbols  -  Continued 


( C ) (D , PS )  t 


Concept:  Conditional,  Take-all  Branching 

indicates  conditional-take  all  branch¬ 
ing  from  the  node. 

Concept:  Condition  Specification  for  Branch 

C  is  the  condition  specification  for  taking 
the  activity. 


Concept : 
Branching 

If  P<1.0, 
activity. 

If  P51,  P 


Attribute  Based  Probabilistic 
P  is  the  probability  of  taking  the 
is  an  attribute  number. 


QSR 


a 


SSR 


Concept:  Selector  node  or  S-node 

QSR  is  the  queue  selection  rule  for  routing 
transactions  to  or  from  Q-nodes. 

SSR  is  the  server  selection  rule  for  deciding 
which  server  to  make  busy  if  a  choice  exists. 

#  is  the  S-node  number. 


Concept:  Routing  Indicator 


ASM 


Routing  indicator  for  transaction  flow  to  or 
from  Q-nodes  to  S-nodes  or  Match  nodes. 

Concept:  Assembly  by  S-nodes 

ASM  is  the  queue  selection  rule  that  requires 
transactions  to  be  assembled  from  two  or  more 
queues . 

Concept:  Blocking 


Blocking  at  an  S-node. 
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Appendix  B,  F-16  Centralized  Data  System  (CDS)  Main¬ 
tenance  Data,  contains  direct  output  for  74ABO,  Low  Power 
Radio  Frequency  (LPRF)  Line  Replaceable  Unit  (LRU)  including: 
column  one — the  Job  Control  number;  column  two — the  action 
taken  code;  column  three — the  maintenance  action  start  time; 
column  four — the  maintenance  action  stop  time;  and  column 
five — the  number  of  personnel  (crew)  performing  the  mainte¬ 
nance  action.  A  total  of  686  maintenance  action  data  points 
were  used  to  develop  parameters  and  probability  distributions. 


Examples 

of  each  type  of 

actions  are 

presented . 

JCN 

ACTION  TAKEN 

START  TIME 

END  TIME 

CREW  SIZE 

0044201 

H 

0920 

1040 

2 

0  0  7  0  8  R  3 

H 

1930 

2230 

2 

01108A3 

w 

2100 

2230 

2 

02^4305 

K 

1600 

1700 

3 

0493906 

H 

1900 

2400 

2 

0534005 

H 

1600 

1900 

2 

0614202 

H 

1600 

1630 

2 

0040674 

p 

1700 

1800 

2 

0274389 

P 

1000 

1100 

2 

0483908 

P 

2100 

2200 

2 

0753905 

P 

1300 

1400 

2 

0913900 

P 

1400 

143  0 

n 

c 

1234201 

p 

0800 

1000 

3 

74 


JCN 

0040674 

0274389 

0483908 

0753905 

0913900 

1234201 

0033607 

0044004 

0113801 

0203920 

0403887 

0524001 

0614011 

0030007 

0039636 

0040322 

0044004 

0047428 

0070011 

0073001 

0014975 

0020101 

0030015 

0031403 

0040013 

0040019 

0040022 


action  taken 

Q 

Q 

Q 

Q 

Q 

Q 

R 

R 

R 

R 

R 

R 

R 

A 

A 

A 

A 

A 

A 

A 

S 

B 

B 

B 

B 

B 

B 


START  TIME 

0800 

1300 

1900 

1000 

2100 

1700 

2100 

0700 

1600 

1600 

2100 

1800 

1600 

1630 

2355 

1000 

1600 

1530 

1630 

1000 

1715 

2015 

1810 

1700 

1000 

0800 

1245 


END  TIME 

0900 
1400 
.  2000" 
1200 
2200 
1900 

2330 

0900 

1700 

1730 

2300 

2000 

1800 

1830 

0500 

1515 

1700 

1630 

2030 

1400 

1900 

2245 

2015 

2100 

1700 

1400 

1450 


CREW  SIZE 

2 

2 

2 

3 

2 

3 

2 

2 

2 

1 

2 

2 

2 

1 

1 

2 

2 

2 

1 

2 

1 

1 

1 

X 

1 

2 

1 

2 
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rcN 

0042850 

0066527 

0176814 

0396203 

0496203 

0500660 

0554205 


ACTION  TAKEN 

START  TIME 

END  TIME 

CREW  SIZE 

1 

0300 

0700 

2 

1 

1400 

1430 

2 

1 

1400 

1545 

3 

1 

0700 

0930 

3 

1 

1700 

1730 

3 

1 

0700 

0900 

2 

1 

2400 

0300 

2 
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Appendix  C  is  divided  into  eight  parts.  Appendix 
Cl  is  computer-generated  condescriptive  statistics,  histo¬ 
gram,  and  goodness-of-f it  test  of  the  interarrival  time  data 
of  Table  I.  Appendix  C2  through  C8  are  computer-generated 
condescriptive  statistics,  histograms,  and  goodness-of-f it 
tests  of  the  test  times  as  shown  in  Table  3- 
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APPENDIX  Cl 

VAL  TIME  CONDESCRIPTIVE  STATISTICS, 
OGRAM,  AND  300DNESS-0F-FIT  Tn,bT 


79 


VARIABLE 

MEAN 

VARIANCE 

MINIMUM 


IAT 

.543 

.736 

0. 

STD  ERR 

SKEWNESS 

MAXIMUM 

.  175 
1.896 
2.500 

STD  DEV 

KURTOSIS 

SUM 

.858 

1.795 

13-040 

VALID  OBSERVATIONS  -  24 


30 


CHI-SQUARE  GOODNESS-OF-FIT  TEST 


TEST  DISTRIBUTION  -  EXPONENTIAL 

CASES  CHI-SQUARE  SIGNIFICANCE 

24  4.125  .042 


H  :  Interarrival  times  of  aircraft  are  exponentially 
o  ° 

distributed . 

H  :  Interarrival  times  of  aircraft  are  not  exponen- 
a  tially  distributed. 

Since  .042  (significance)  >  .01  alpha  value,  the  null  hypothe¬ 
sis  that  the  interarrival  times  of  aircraft  are  exponentially 
distributed  cannot  be  rejected. 


APPENDIX  C2 

CONDESCRIPTIVE  STATISTICS,  HISTOGRAM,  AND 
GOODNESS-OF-FIT  TESTS  FOR  THE  TIME-TO-CND 
RANDOM  VARIABLE 
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r 


VARIABLE 

CND 

MEAN 

4.858 

STD  ERR 

.721 

STD  DEV 

5-099 

VARIANCE 

25.997 

SKEWNESS 

3.238 

KURTOSIS 

12.729 

MINIMUM 

1.000 

MAXIMUM 

30.000 

SUM 

242.900 

VALID  OBSERVATIONS 
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VO 
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rH 

rH 
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CHI-SQUARE  GOODNESS-OF-PIT  TEST 


TEST  DISTRIBUTION  -  EXPONENTIAL 

CASES  CHI-SQUARE  SIGNIFICANCE 

50  1.712  .788 

H  :  Tlme-to-CND  LRPF  write-ups  are  exponentially 
distributed. 

H  :  Time-to-CND  LPRF  write-ups  are  not  exponentially 
A  distributed. 

Since  .788  (significance)  >  .01  alpha  value,  the  null  hypothe¬ 
sis  that  the  time-to-CND  LPRF  write-ups  are  exponentially 
distributed  cannot  be  rejected. 


APPENDIX  C3 


CONDESCRIPTIVE  STATISTICS,  HISTOGRAM,  AND 
GOODNESS-OP- PIT  TESTS  FOR  THE  TIME-TO-REMOVE 
RANDOM  VARIABLE 


VARIABLE  REMOVAL 


MEAN 

4.504 

STD  ERR 

1.089 

STD  DEV 

5.335 

VARIANCE 

28.461 

SKEWNESS 

2.970 

KURTOSIS 

9.791 

MINIMUM 

.500 

MAXIMUM 

25.000 

SUM 

108.100 

VALID  OBSERVATIONS  -24 
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CHI-SQUARE  GOODNESS-OF-FIT  TEST 


TEST  DISTRIBUTION  -  EXPONENTIAL 

CASES  CHI-SQUARE  '  SIGNIFICANCE 

24  .407  .816 

Hq:  Time-to-remove  LPRFs  are  exponentially  distributed. 

H  :  Time-to-remove  LPRFs  are  not  exponentially 
distributed. 

Since  .816  (significance)  >  .01  alpha  value,  the  null  hypothe¬ 
sis  that  time-to-remove  LPRFs  are  exponentially  distributed 
cannot  be  rejected. 
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APPENDIX  C4 

CONDESCRIPTIVE  STATISTICS,  HISTOGRAM,  AND 
GOODNESS-OP-FIT  TESTS  FOR  THE 
TIME-TO- INSTALL  RANDOM  VARIABLE 


VARIABLE  INSTALL 


MEAN 

4.450 

STD  ERR 

.984 

STD  DEV 

4.823 

VARIANCE 

23.260 

SKEWNESS 

4.410 

KURTOSIS 

4.410 

MINIMUM . 

1.000 

MAXIMUM 

20.000 

SUM 

106.800 

VALID  OBSERVATIONS  -  24 
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CHI-SQUARE  GOODNESS-OF-FIT  TEST 


TEST  DISTRIBUTION  -  EXPONENTIAL 

CASES  CHI-SQUARE  SIGNIFICANCE 

24  .012  .994 

H  :  Time-to-install  LPRFs  are  exponentially  dis- 
0  tributed. 

H  :  Time-to-install  LP.PFs  are  not  exponentially 
d'  distributed. 

Since  .994  (significance)  >  .01  alpha  value,  the  null  hypothe¬ 
sis  that  time-to-install  LPRFs  are  exponentially  distributed 
cannot  be  rejected. 
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AFPENDIX  C5 

CONDESCRIPTIVE  STATISTICS,  HISTOGRAM,  AND 
GOODNESS-OF-FIT  TESTS  FOR  THE 
TIME-TO-REMOVE  AND  REPLACE  RANDOM  VARIABLE 
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VARIABLE 

R&R 

MEAN 

5.115 

STD  ERR 

.411 

STD  DEV 

4.429 

VARIANCE 

19.615 

SKEWNESS 

2.854 

KURTOSIS 

9.734 

MINIMUM 

1.000 

MAXIMUM 

28.000 

SUM 

593-300 

VALID  OBSERVATIONS  -116 


o\ 

j=r 


3(6 

s* 

3(6 

* 

s* 

* 

* 

* 

* 

* 

3(6 

♦ 

* 

* 

3(6 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

3(6 

* 

* 


CM 

-=T 


* 

* 

* 

* 

* 

3(6 

* 

* 

* 

3(6 

3(6 

3(6 

3(6 

3(6 

* 

3(6 

3(6 

3(e 

3(6 

3(6 

3(6 

3(6 


3(6 

3(e 

M 

o 

3(6 

3(6 

/-N 

cu 

3(6 

3(6 

-=r 

3* 

3(6 

rH 

3(6 

* 

3(6 

3(6 

3(6 

3(6 

3(6 

3(6 

3(6 

3(6 

3(6 

* 

3(6 

3(6 

* 

3(6 

3(6 

3(6 

3(6 

M 

o 

3(6 

3(6 

3(< 

i—* 

3(6 

* 

3(6 

3(6 

3(6 

3(6 

- - N 

o 

3(6 

3(6 

3(6 

on 

2 

3(6 

3(6 

3(6 

CM 

OJ 

C\J 

z-' 

Z*v 

W 

3(6 

3(6 

3(6 

' — ' 

w 

t — 1 

rH 

tD 

*6 

3(6 

3(6 

3(6 

c? 

3(6 

3(6 

3(6 

3(6 

3(6 

3(6 

3(6 

w 

3(6 

3(6 

3(6 

3(6 

3(6 

3(6 

3(6 

3(6 

3(6 

cc 

HI  *  M 

H#  H 

M#  H 

H  3(6  H 

VH  3(6 

H  H  3(6  M 

M  3(6  M 

M  3(6  M 

M  3(?  M 

M  M 

O  lx. 

1x3 

a 

o  o 

o 

o 

o 

O 

O 

o 

o 

O 

o  o 

o 

o 

O 

O 

o 

O 

O 

O 

cc 

o 

t— 

LA 

CO 

i — 1 

ON 

C^ 

on 

rH 

o» 

• 

• 

• 

• 

• 

• 

• 

• 

• 

cc 

rH 

O 

on 

LA 

CO 

-zr 

o- 

rH 

rH 

rH 

rH 

CM 

CM 

o 

LH 


O 


o 

on 


i- 


92 


CHI-SQUARE  GOODNESS-OP- FIT  TEST 


TEST  DISTRIBUTION  -  EXPONENTIAL 

CASES  CHI-SQUARE  SIGNIFICANCE 

116  10.623  .059 


H  :  Time-to-remove  and  replace  LPRFs  are  exponen- 
°  tially  distributed. 

H  :  Time-to-remove  and  replace  LPRFs  are  not  expo- 
cl  nentially  distributed. 

Since  .059  (significance)  >  .01  alpha  value,  the  null  hypothe¬ 
sis  that  time-to-remove  and  replace  LPRFs  are  exponentially 
distributed  cannot  be  rejected. 


93 


VARIABLE 


BC&RP 


MEAN 

12.503 

STD  ERR 

.578 

STD  DEV 

10.806 

VARIANCE 

116.774 

SKEWNESS 

3. 108 

KURTOSIS 

17.382 

MINIMUM 

.  400 

MAXIMUM 

101.400 

SUM 

4363.450 

VALID  OBSERVATIONS  -  3^9 
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CHI-SQUARE  GOODNESS-OF-PIT  TEST 


TEST  DISTRIBUTION  -  EXPONENTIAL 

CASES  CHI-SQUARE  SIGNIFICANCE 

349  9.898  .019 


H  :  Time-to-bench  check  and  repair  LPRFs  are  expo- 
nentially  distributed. 

H  :  Time-to-bench  check  and  repair  LPRFs  are  not 
a  exponentially  distributed. 

Since  .019  (significance)  >  .01  alpha  value,  the  null  hypothe¬ 
sis  that  time-to-bench  check  and  repair  LRPFs  are  exponentially 
distributed  cannot  be  rejected. 
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VARIABLE 


RTOK 


MEAN 

7.212 

STD  ERR 

.427 

STD  DEV 

7.284 

VARIANCE 

53-050 

SKEWNESS 

4.641 

KURTOSIS 

27.866 

MINIMUM 

1.000 

MAXIMUM 

61.000 

SUM 

2089.700 

VALID  OBSERVATIONS  -291 
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CHI-SQUARE  GOODNESS-OF-FIT  TEST 


TEST  DISTRIBUTION  -  EXPONENTIAL 

CASES  CHI-SQUARE  SIGNIFICANCE 

291  1.9^2  .584 

H  :  Time-to-bench  check  LPRFs  with  no  repair 
0  required  are  exponentially  distributed. 

H  :  Time-to-bench  check  LPRFs  with  no  repair 
a  required  are  not  exponentially  distributed. 

Since  .584  (significance)  >  .01  alpha  value,  the  null  hypothe¬ 
sis  that  time-to-bench  check  LPRFs  with  no  repair  required 
are  exponentially  distributed  cannot  be  rejected. 
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APPENDIX  C8 

CONDESCRIPTIVE  STATISTICS,  HISTOGRAM,  AND 
GOODNESS-OF-PIT  TESTS  FOR  TIME-TO-NRTS 
RANDOM  VARIABLE 
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VARIABLE 

MEAN 

VARIANCE 

MINIMUM 


NRTS 

5.243 

25.607 

.500 


STD  ERR  .746 
SKEWNESS  1.892 
MAXIMUM  25.700 


STD  DEV  5.060 
KURTOSIS  4.840 
SUM  241.200 


VALID  OBSERVATIONS  - 
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CHI-SQUARE  GOODNESS-OF-FIT  TEST 


TEST  DISTRIBUTION  -  EXPONENTIAL 

CASES  CHI-SQUARE  SIGNIFICANCE 

46  1.680  .794 

H  :  Time-to-test  LPRFs  when  repair  is  beyond  the 

base’s  capability  are  exponentially  distributed. 

H  :  Time-to-test  LPRFs  when  repair  is  beyond  the 
J  base's  capability  are  not  exponentially  distributed. 

Since  .794  (signif icance )  >  .01  alpha  value,  the  null  hypothe¬ 
sis  that  time-to-test  LPRFs  when  repair  is  beyond  the  base's 
capability  are  exponentially  distributed  cannot  be  rejected. 
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Appendix  D,  Q-GERT  Simulation  Model  Program,  contains 


the  computer  input  to  run  the  Q-GERT  simulation  program. 


*»*  INPUT  CARDS  *** 

GEN, BENONE, THESIS, 09, 28 , 198 3 , 9 , 1 , 2000 , 6000 , 27 , E , (14)2* 

SOU, 1,0,1, A*  GENERATE  ARRIVALS 

VAS,1,1,IN,1*  INCREMENT  ARRIVALS 

REG, 2/ACTION, 1, 1,P*  DETERMINE  WRITE-UP  ACTION 

QUE, 3/WRITEUP, , ,D,F*  AIRCRAFT  HAS  A  WRITE-UP 

STA, 4/FL  ACT,1,1,P,I*  DECIDE  FLIGHTLINE  ACTION 

STA,5/T-SHOOT, 1, 1,P,I*  WRITE-UP  IS  TROUBLESHOT 

STA,6/CND  STAT, 1, 1,D,I*  WRITE-UP  IS  A  CND 

REG, 7/REMOVE, 1,1, D*  REMOVE  ACTION 

VAS, 7, 2, CO, 2*  ASSIGN  A  REMOVE  ATTRIBUTE 

STA, 8 /REM  LRU , 1 , 1 , D , I  *  TRANSPORT  REMOVED  LRU 

QUE, 9 /REM  QUE,0, ,D,F, ( 10) 15*  HOLD  REMOVED  LRU  FOR  AIS 

REG, 10/REM&REP, 1, 1,D*  REMOVE  AND  REPLACE  ACTION 

VAS, 10, 2, CO, 3*  ASSIGN  REMOVE  AND  REPLACE  ATTRIBUTE 

QUE, ll/R&R  QUE, 0,,D,F,(10)12*  HOLD  R&R  LRU  FOR  ASSEMBLY 

SEL, 12/R&R  JOIN, ASM, (7)25,11*  ASSY  OF  R&R  ACTIONS  AND  UNITS 

STA,13/R&R  STAT,1,1,D,I*  REMOVE  AND  REPLACE  STATISTICS 

QUE , 14 /R&R  QUE ,,,D,F, (10)15*  HOLD  REMOVE  AND  REPLACE  LRU  FOR  ACTION 

SEL, 15/AIS, POR ,(6)B,9,14*  AIS  TEST  STATION 

QUE, 16/AIS  ACT,0,,P,F*  DETERMINE  TEST  ACTION 

STA, 17 /BCNRP , 1, 1,D, I*  BENCH  CHECK  NO  REPAIR  (RTOK) 

STA, 18/BCRP, 1, 1,D,I*  BENCH  CHECK  AND  REPAIR 

STA, 19/NRTS, 1, 1,D,I*  NOT  REPAIRABLE  THIS  STATION  ( NRTS ) 

REG, 20/REPAIR, 1, 1,F*  ROUTE  REPAIRED  UNIT 

QUE, 21/SUPPLY, 2, ,D,F, 24*  BASE  SUPPLY 

QUE, 22/INSTALL, , ,D,F*  HOLD  FOR  INSTALLATION  ACTION 

STA,23/INST-STA,1,1,D,I*  INSTALLATION  STATISTICS 

QUE, 2 4 /DEPOT, , ,D,F*  DEPOT 

QUE, 25/FL  SUP, 2, 2, D, F, ( 10)12*  FLIGHTLINE  SUPPLY  QUE 

SIN, 40/OPREADY, 1, 1,D,I*  OPERATIONAL  READY  SINK 

ACT, 1, 1, EX, 1, 1, /GENERATE, (9) Al.LE. 1999* 

PAR, 1,0. 54, 0,2. 5* 

ACT ,1,2, , ,2, (9)A1.GE.0* 

ACT, 2, 3, , ,3/ACTION, (8)0. 3* 

ACT2, 40, , ,4/NOACTION, ,0.7* 

ACT, 3, 4, , ,5/WRITEUP* 

ACT , 4 , 5 , , , 6 /T-SHOOT ,2,0.74* 

ACT ,4,6,EX,2,7/CND,2,0.26* 

PAR, 2, 4. 858, 1.0, 30.0* 

ACT, 6, 40, (8)16* 

ACT, 5,7,, ,8, ,0.17* 
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ACT, 5, 10, ,,9, ,0.83* 

ACT, 7, 3, EX, 3, 10/REM  LRU* 

PAR, 3, 4.504, 0.5, 25.0* 

ACT, 8 , 9 , CO , 2 , 11/AIS  TRANS* 

ACT, 10, 11, , ,12/R&R* 
ACT,12,13,EX,4,13* 

PAR, 4,5. 115,1.0,28.0* 

ACT, 13, l4,CO,2, 14/AIS  TRANS* 
ACT, 13,40, ,,15* 

ACT, 15,16(6)17/ AIS, 2* 

ACT, 16, 17, EX, 5, 18/BCNRP, ,0.42* 
PAR, 5, 7. 212, 1.0, 61.0* 

ACT, 16, 18, EX, 6, 18/BCRP, ,0.51* 
PAR, 6, 12. 503, 0.4, 101. 4* 

ACT, 16, 19, EX, 7, 18/NRTS, ,0.07* 
PAR, 7, 5. 243, 0.5, 25. 7* 

ACT, 17,20, , ,21* 

ACT, 18,20, , ,22* 

ACT, 19,20, ,,23* 

ACT ,  19 , 2  4  ,  CO ,  4  8 , 2  6  /D-  NRTS  * 

ACT, 20, 21, CO, 0. 1,24, , ,A2.EQ. 3* 
ACT, 20, 22, CO, 0. 1,25, , ,A2.EQ. 2* 
ACT, 22, 23, EX, 8, 27/INST* 

PAR, 8, 4. 45, 1.0, 20.0* 

ACT, 24, 2 l,LO, 9, 29 /INSUP, 3* 

PAR, 9, 14.0,0.0, , 11.9* 

ACT, 21, 25, CO, 0. 1,30* 

ACT, 23, 40,, ,28* 

FIN* 


105 


APPENDIX  E 

O-GERT  TRACE  AND  TRANSACTION  PASSAGES 
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Appendix  E  is  divided  into  two  parts.  Appendix  El 
is  a  Q-GERT  trace,  which  gives  a  sample  of  the  Q-GERT  output 
to  enable  the  user  to  trace  individual  transactions  through 
the  Q-GERT  network.  Appendix  E2,  Q-GERT  Transaction  Passages, 
gives  the  number  of  actions  experienced  at  each  node  of  the 
model.  Branching  coefficients  can  be  confirmed  for  nodes 
affected  in  the  model.  Column  one  shows  the  node  number. 
Column  two  shows  the  number  of  transaction  passages  through 
that  node.  Column  three  shows  the  Q-GERT  generated  branching 
coefficients  for  that  node.  Column  four  shows  the  branching 
coefficient  originally  modeled. 
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APPENDIX  P 

Q-GERT  MODEL  VERIFICATION  CONDESCRIPTIVE 
STATISTICS,  HISTOGRAMS,  AND  GOODNESS-OF-FIT  TESTS 
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APPENDIX  FI 


C0ro^&l-PITS®T•0?Q»,  AND 

GOODNbbb  up  ttMF.S 
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i 


VARIABLE 


IAT 


MEAN 

.645 

STD  ERR 

.  116 

STD  DEV 

.645 

VARIANCE 

.416 

SKEWNESS 

1.737 

KURTOSIS 

2.917 

MINIMUM 

.  100 

MAXIMUM 

2.500 

SUM 

20.000 

VALID  OBSERVATIONS  -  31 
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CHI-SQUARE  GOODNESS-OF-FIT  TEST 


TEST  DISTRIBUTION 

CASES 

31 


EXPONENTIAL 

CHI-SQUARE 

2.593 


SIGNIFICANCE 

.^59 


H  :  Q-GERT  generated  Interarrival  times  of  aircraft 
°  are  exponentially  distributed. 

H  :  Q-GERT  generated  interarrival  times  of  aircraft 
a  are  not  exponentially  distributed. 

Since  .459  (significance)  >  .01  alpha  value,  the  null  hypothe¬ 
sis  that  the  Q-GERT  generated  interarrival  times  of  aircraft 
are  exponentially  distributed  cannot  be  rejected. 


5 


APPENDIX  F2 

CONDESCRIPTIVE  STATISTICS,  HISTOGRAM,  AND 
GOODNESS-OP-FIT  TESTS  FOR  THE  Q-GERT 
GENERATED  TIME-TO-CND  RANDOM  VARIABLE 
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VARIABLE  CND 


MEAN 

6.387 

STD  ERR 

1.124 

STD  DEV 

6.259 

VARIANCE 

39. 178 

SKEWNESS 

1.708 

KURTOSIS 

2.923 

MINIMUM 

1.000 

MAXIMUM 

25.000 

SUM 

198.000 
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CHI-SQUARE  GOODNESS-OF-FIT  TEST 


TEST  DISTRIBUTION  -  EXPONENTIAL 

CASES  CHI-SQUARE  SIGNIFICANCE 

31  1.931  .587 

H  :  Q-GERT  generated  times-to-CND  are  exponentially 
0  distributed 

H  :  Q-GERT  generated  times-to-CND  are  not  exponen- 
a  tially  distributed. 

Since  .587  (significance)  >  .01  alpha  value,  the  null  hypothe¬ 
sis  that  the  Q-GERT  generated  times-to-CND  are  exponentially 
distributed  cannot  be  rejected. 
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APPENDIX  F3 


rtwtTVF  STATISTICS,  HISTOGRAM,  AMD 
GOODNESS-OF-FIT  TEST  ON  Q-GERT  GENERATED 
TIME-TO-REMOVE  RANDOM  VARIABLE 
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VARIABLE 


REMOVE 


MEAN  5-855 
VARIANCE  3^.803 
MINIMUM  . 500 


STD  ERR  1.060 
SKEWNESS  1.744 
MAXIMUM  23.000 


STD  DEV  5.899 
KURTOSIS  3.003 
SUM  181.500 


VALID  OBSERVATIONS  -  31 
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CHI-SQUARE  GOODNESS-OF-FIT  TEST 


TEST  DISTRIBUTION  -  EXPONENTIAL 


CASES 

31 


CHI-SQUARE 

3.109 


SIGNIFICANCE 

.590 


H  :  Q-GERT  generated  times-to-remove  are  exponen- 
J  tially  distributed. 

H  :  Q-GERT  generated  times-to-remove  are  not 
'  exponentially  distributed. 

Since  .pUO  ( signf icance )  >  .01  alpha  value,  the  null  hypothe¬ 
sis  that  the  Q-GERT  generated  times-to-remove  are  exponentially 
distributed  cannot  be  rejected. 
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APPENDIX  F4 

CONDESCRIPTIVE  STATISTICS,  HISTOGRAM,  AMD 
GOODNESS-OF-FIT  TEST  ON  Q-GERT  GENERATED 
TIME-TO- INSTALL  RANDOM  VARIABLE 
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VARIABLE 


INSTALL 
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CHI-SQUARE  GOODNESS-OP-FIT  TEST 


TEST  DISTRIBUTION  -  EXPONENTIAL 


CASES 

31 


CHI-SQUARE 

1.183 


SIGNIFICANCE 

.757 


H  :  Q-GERT  generated  times-to-install  are  exponen- 
°  tially  distributed. 

H  :  Q-GERT  generated  times-to-install  are  not  expo¬ 
nentially  distributed. 

Since  .757  ( signf icance )  >  .01  alpha  value,  the  null  hypothe¬ 
sis  that  the  Q-GERT  generated  times-to-install  are  exponentially 
distributed  cannot  be  rejected. 
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VARIABLE 


R&R 


MEAN 

6.742 

STD  ERR 

1.  182 

STD  DEV 

6.583 

VARIANCE 

43.331 

SKEWNESS 

1.774 

KURTOSIS 

3.145 

MINIMUM 

1.000 

MAXIMUM 

26.000 

SUM 

209.000 

VALID  OBSERVATIONS  -  31 


CHI-SQUARE  GOODNESS-OP-PIT  TEST 


TEST  DISTRIBUTION  -  EXPONENTIAL 


CASES 

31 


CHI-SQUARE 

.809 


SIGNIFICANCE 

.847 


H  :  Q-GERT  generated  times-to-remove  and  replace  are 
°  exponentially  distributed. 

H  :  Q-GERT  generated  times-to-remove  and  replace  are 
a  not  exponentially  distributed. 

Since  .847  (significance)  >  .01  alpha  value,  the  null  hypothe¬ 
sis  that  the  Q-GERT  generated  times-to-remove  and  replace  are 
exponentially  distributed  cannot  be  rejected. 
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APPENDIX  F6 

CONDESCRIPTIVE  STATISTICS,  HISTOGRAM,  AND 
GOODNESS-OF-FIT  TEST  ON  Q-GERT  GENERATED 
TIME-TO-BENCH  CHECK  AND  REPAIR  RANDOM  VARIABLE 
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VARIABLE 


BC&RP 


MEAN 

16.006 

VARIANCE 

264.836 

MINIMUM 

.  400 

STD  ERR  2.923 
SKEWNESS  1.679 
MAXIMUM  63.000 


STD  DEV  16.274 
KURTOSIS  2.860 
SUM  496.200 


VALID  OBSERVATIONS  -  31 
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CHI-SQUARE  GOODNESS-OF-FIT  TEST 


TEST  DISTRIBUTION  -  EXPONENTIAL 


CASES 

31 


CHI-SQUARE 

1.574 


SIGNIFICANCE 

.813 


H  :  Q-GERT  generated  times-to-bench  check  and  repair 
u  are  exponentially  distributed. 

H  :  Q-GERT  generated  times-to-bench  check  and  repair 
are  not  exponentially  distributed. 

Since  .813  (significance)  >  .01  alpha  value,  the  null  hypothe¬ 
sis  that  the  Q-GERT  generated  times-to-bench  check  and  repair 
are  exponentially  distributed  cannot  be  rejected. 
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APPENDIX  F7 

OTE-TO-b'eSc'h  CHEcfwTH  NO  REPAIH  WOK, 
TI^h  RANDOM  VARIABLE, 
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VARIABLE 


RTOK 


MEAN 

9.323 

STD  ERR 

1.672 

STD  DEV 

9.307 

VARIANCE 

86.626 

SKEWNESS 

1.764 

KURTOSIS 

3.120 

MINIMUM 

1.000 

MAXIMUM 

37.000 

•SUM 

289.000 

VALID  OBSERVATIONS  -  31 
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CHI-SQUARE  GOODNESS-OF-FIT  TEST 


TEST  DISTRIBUTION  -  EXPONENTIAL 


CASES 

31 


CHI-SQUARE 

1.705 


SIGNIFICANCE 

.636 


H  :  Q-GERT  generated  times-to-bench  check  with  no 
°  repair  (RTOK)  are  exponentially  distributed. 

H  :  Q-GERT  generated  times-to-bench  check  with  no 
a  repair  (RTOK)  are  not  exponentially  distributed. 

Since  .636  (significance)  >  .01  alpha  value,  the  null  hypothe¬ 
sis  that  the  Q-GERT  generated  times-to-bench  check  with  no 
repair  (RTOK)  are  exponentially  distributed  cannot  be  rejected. 
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VARIABLE 


NRTS 


MEAN  6*24? 
VARIANCE  ^2.698 
MINIMUM  .500 

VALID  OBSERVATIONS 


STD  ERR  1-  I?  4 
SKEWNESS  1.731 
MAXIMUM  25.000 

31 


STD  DEV  6.53^ 
KURTOSIS  2.801 
SUM  ' 193.500 
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CHI-SQUARE  GOODNESS-OF-FIT  TEST 


TEST  DISTRIBUTION  -  EXPONENTIAL 

CASES  CHI-SUARE  SIGNIFICANCE 

31  . 5^6  .909 

f 

H  :  Q-GERT  generated  times-to-NRTS  are  exponentially 
distributed. 

H  :  Q-GERT  generated  times-to-NRTS  are  not  exponen- 
a  tially  distributed. 

Since  .909  (significance)  >  .01  alpha  value,  the  null  hypothe¬ 
sis  that  the  Q-GERT  generated  times-to-NRTS  are  exponentially 
distributed  cannot  be  rejected. 
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APPENDIX  F9 

CONDESCRIPTIVE  STATISTICS,  HISTOGRAM,  AND 
GOODNESS-OF-FIT  TEST  ON  O-GERT  GENERATED 
DEPOT  REPAIR  TIME  RANDOM  VARIABLE 
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VARIABLE  DEPOT 


MEAN 

14.613 

STD  ERR 

2. 119 

STD  DEV 

11.797 

VARIANCE 

139.178 

SKEWNESS 

1.870 

KURTOSIS 

3.706 

MINIMUM 

2.000 

MAXIMUM 

51.000 

SUM 

453.000 

VALID  OBSERVATIONS  -  31 
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KOLMOGOROV-SMIRNOV  GOODNESS-OP-FIT  TEST 

TEST  DISTRIBUTION  -  NORMAL  (MEAN  =  2.413,  STD  DEV  =  .738) 

CASES  =  31  MAX  (ABS  DIFF)  =  .1013 

K-S  Z  =  2.427  2-TAILED  P  =  .000 

n  =  31;  a  =  .01  Lilliefors  Ta^ie  Value  =  .185 

H  :  Distribution  of  depot  maintenance  times  are  log¬ 
normal;  logarithms  of  depot  maintenance  times 
are  normally  distributed. 

H  :  Distribution  of  depot  maintenance  times  are  not 
a  lognormal;  logarithms  of  depot  maintenance  times 
are  not  normally  distributed. 

Since  .1013'  <  .185,  cannot  reject  the  null  hypothesis  that  depot 
maintenance  times  are  lognormally  distributed. 
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APPENDIX  G 

Q-GERT  GENERATED  RESPONSE  SURFACES 
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Appendix  G  is  the  Q-GERT  generated  output  of  the  sim¬ 
ulation  model;  Part  I ’shows  the  results  for  the  reduction  in 
CND  actions  by  one-third  and  then  two-thirds.  Part  II  shows 
the  results  for  the  reduction  in  RTOK  actions  by  one-third  and 
then  two-thirds.  Part  III  shows  the  results  for  the  combined 
reduction  in  CND/RTOK  actions  by  one-third  and  then  two-thirds. 
Column  one  shows  the  run  number,  each  consisting  of  2000  air¬ 
craft  generate-!  to  OR  status.  Column  two  shows  the  reduction: 
baseline;  actions  reduced  by  one-third;  and  actions  reduced  by 
two-thirds.  Column  three  shows  the  time  required  to  generate 
the  2000  OR  aircraft. 
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CND  ACTIONS 


Run  § 


Reduction 


Time  to  Generate  OR  Aircraft 


Baseline 

4113.18 

1/3 

4502.30 

2/3 

4423.43 

Baseline 

3871.84 

1/3 

4135.66 

2/3 

3999.63 

Baseline 

4499.28 

1/3 

4283.99 

2/3 

4570.46 

Baseline 

4546.18 

1/3 

4357.37 

2/3 

4162.61 

Baseline 

4354.65 

1/3 

3796.08 

2/3 

4054.12 

Baseline 

4298.91 

1/3 

4170.20 

2/3 

4062.36 

Baseline 

4002.81 

1/3 

3963.80 

2/3 

3896.07 

Baseline 

4595. 18 

1/3 

4172.00 

2/3 

4116.72 

Baseline 

4756.06 

1/3 

4234.09 

2/3 

4306.90 

Baseline 

4774.64 

1/3 

4885.22 

2/3 

4521.49 

Baseline 

3800.83 

1/3 

4237 . 45 

2/3 

3898.34 

Run  # 

Reduction 

12 

Baseline 

1/3 

2/3 

13 

Baseline 

1/3 

2/3 

14 

Baseline 

1/3 

2/3 

15 

Baseline 

1/3 

2/3 

16 

Baseline 

1/3 

2/3 

17 

Baseline 

1/3 

2/3 

18 

Baseline 

1/3 

2/3 

19 

Baseline 

1/3 

2/3 

20 

Baseline 

1/3 

2/3 

21 

Baseline 

1/3 

2/3 

22 

Baseline 

1/3 

2/3 

23 

Baseline 

1/3 

2/3 

Time  to  Generate  OR  Aircraft 

4257.87 

4480.81 

4450.81 

4399.31 
3722.07 
4351.83 

4020.53 
4479.39 

4209.53 

4697.73 

3830.01 

4216.32 

4133-57 

4594.05 

4474.28 

4592. 14 
4221.57 
3868.25 

4000.42 

4241.55 
3872.65 

4482.20 
4259-93 
4576.96 

4081.48 
4342.85 
4397 . 11 

4628.55 

4208.20 
4464.18 

4184.24 

4681.33 
4515.71 

4151.50 

4297.67 

4175-94 
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Run  # 


Reduction 


Time  to  Generate  OR  Aircraft 


Baseline 

4101.66 

1/3 

4210.61 

2/3 

4631.96 

Baseline 

4357.79 

1/3 

3918.42 

2/3 

4408.26 

Baseline 

4206.73 

1/3 

4082.15 

2/3 

3806.68 

Baseline 

4662.79 

1/3 

4634 . 48 

4038.55 

RTOK  ACTIONS 


Run  #_ 
1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 


Reduction  Time  to  Generate  OR  Aircraft 


Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 


4113.18 

3757. 19 
3940.45 

3871.84 

3799.76 
3603.03 

4499-28 

4474.78 

3307.95 

4546.18 

3799.77 
3381.22 

4354.65 

4229.76 

3511.08 

4298.91 
3963.36 
4219 • 40 

4002.81 
4003.61 
3436.70 

4595.18 
3644.42 

3133.20 

4756.06 

4126.29 

3192.82 

4774.64 
4362. 12 
3448.75 

3800.83 

3871.99 

3830.09 
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Run  4 

Reduct  ion 

Time  to  Generate 

12 

Baseline 

4257.87 

1/3 

4309.59 

2/3  • 

3429.82 

13 

Baseline 

4399.31 

1/3 

3651.45 

2/3 

3445.63 

14 

Baseline 

4020.53 

1/3 

3527.64 

2/3 

4067.34 

15 

Baseline 

4697.73 

1/3 

3545.36 

2/3 

3701.06 

16 

Baseline 

4133.57 

1/3 

3906.25 

2/3 

3162.22 

17 

Baseline 

4592.14 

1/3 

4025.86 

2/3 

3639.44 

18 

Baseline 

4000.42 

1/3 

4268.04 

2/3 

3570.64 

19 

Baseline 

4482.20 

1/3 

3826.95 

2/3 

3676.42 

20 

Baseline 

4081.48 

1/3 

3785.12 

2/3 

3657.87 

21 

Baseline 

4628.55 

1/3 

3791.80 

2/3 

4087.97 

22 

Baseline 

4l84 . 24 

1/3 

4167.24 

2/3 

3835.77 

23 

Baseline 

4151.50 

1/3 

4508.28 

2/3 

3779.45 
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Reduction 


Baseline 

1/3 

2/3 


Baseline 

1/3 

2/3 


Baseline 

1/3 

2/3 


Time  to  Generate  OR  Aircraft 

4101.66 
3862.34 

3519.28 

4357.79 
3630.27 

3208.87 

4206.73 

4342.88 
3897.56 


Baseline 

1/3 

2/3 


4662.79 

4047.91 

3826.16 


VO 


CND/RTOK  ACTIONS 


Run  # 


Reduction 


Time  to  Generate  OR  Aircraft 


1 


2 

3 

A 

5 


7 

S 

9 

10 


11 


Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

3aseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 


4113. 18 
3963.25 

3527.84 

3871.84 
3624.58 

3384.96 

4499.28 

3981.71 

3337.28 

4546 . 18 
4139.16 
3567.55 

4354.65 
3571.68 
3234 . 54 

4298.91 

3985.06 

3324.72 

4002.81 

3539.96 
3136.87 

4595.18 
3938.77 
2714.62 

4756.06 

4227.86 

2926.21 

4774.64 

3993.40 

3571.81 

3800.33 

3748.41 

3092.34 
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Run  # 

Reduction 

12 

Baseline 

V3 

2/3- 

13 

Baseline 

1/3 

2/3 

14 

Baseline 

1/3 

2/3 

15 

Baseline 

1/3 

2/3 

16 

Baseline 

1/3 

2/3 

17 

Baseline 

1/3 

2/3 

13 

Baseline 

1/3 

2/3 

19 

Baseline 

1/3 

2/3 

20 

Baseline 

1/3 

2/3 

21 

Baseline 

1/3 

2/3 

Baseline 

1/3 

2/3 

23 

Baseline 

1/3 

2/3 

Time  to  Generate  OR  Aircraft 

4257.87 

3915-31 

3361.22 

4399.31 

3613.72 
3030.78 

4020.53 

3691.70 

3496.07 

4697.73 
38 18 . 68 
3332.63 

4133.57 

3508.67 
2617 .80 

4  50  2.14 
3349.06 
2791.11 

4000 .42 

4106. 19 
3162 .24 

4482 . 20 
3477.97 
3183.38 

4081.48 

3569.23 
3502.08 

4528.55 

3658 . 68 

3358.30 

4184.24 
3858.90 
3315.09 

4151.50 

3743.99 

3373.56 
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Run  # 


Reduction 


Time  to  Generate  OR  Aircraft 


24 

Baseline 

4101.66 

1/3 

3600.25 

2/3 

2963.21 

25 

Baseline 

4357.79 

1/3 

3746.76 

2/3 

3038.69 

26 

Baseline 

4206.73 

1/3 

3485.84 

2/3 

3158.91 

27 

Baseline 

4662.79 

1/3 

4059.65 

2/3 

3299.87 
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TESTS  FOR  HOMOGENEITY  OF  VARIANCES 

COCHRANS  C  =  MAX  VARIANCE/SUM  (VARIANCES) 

=  .3585,  P  =  1.000  (approx.) 

BARTLETT-BOX  F  =  .133,  P  -  .875 

MAXIMUM  VARIANCE/MINIMUM  VARIANCE  =  1.214 

H  :  Variances  of  average  time  to  generate  OR  alr- 
0  craft  are  equal  for  Baseline,  CND’s  reduced  by 
1/3,  and  CND’s  reduced  by  2/3- 

H  :  Variances  of  average  time  to  generate  OR  air¬ 
craft  are  not  equal  for  Baseline  CMD's  reduced 
by  1/3,  and  CND’s  reduced  by  2/3. 

Since  the  P  values  for  Cochran ’ s C and  Bartlett-Box  tests  are 

greater  than  0.000,  cannot  reject  the  null  hypothesis  that  the 

variances  are  equal.  Therefore,  ANOVA  can  be  used  to  test  the 

differences  of  means. 


APPENDIX  H2 

HOMOGENEITY  OF  VARIANCE  TEST  OF  RTOK  ACTIONS 
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TESTS  FOR  HOMOGENEITY  OF  VARIANCES 


COCHRANS  C  =  MAX  VARIANCE/SUM  (VARIANCES) 

=  .3512,  P  =  1.000  (approx.) 

BARTLETT-BOX  F  *  .030,  P  =  .970 

MAXIMUM  VARIANCE/MINIMUM  VARIANCE  =  1.100 

H  :  Variances  of  average  time  to  generate  OR  air- 
0  craft  are  equal  for  Baseline,  RTOK's  reduced  by 
1/3,  and  RTOK's  reduced  by  2/3. 

H  :  Variances  of  average  time  to  generate  OR  air¬ 
craft  are  not  equal  for  Baseline,  RTOK's  reduced 
by  1/3,  and  RTOK's  reduced  by  2/3. 

Since  the  P  values  for  Cochran’s  C  and  Bartlett-Box  tests  are 

greater  than  0.000,  cannot  reject  the  null  hypothesis  that  the 

variances  are  equal.  Therefore,  ANOVA  can  be  used  to  test  the 

difference  of  means. 
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APPENDIX  H3 

homogeneity  or  variance  test  or  cnd/rtok  actions 


TESTS  FOR  HOMOGENEITY  OF  VARIANCES 


COCHRANS  C  *  MAX  VARIANCE/SUM  (VARIANCES) 

=  .^095,  P  =  .469  (approx.) 

BARTLETT-BOX  F  =  .788,  P  =  .455 

MAXIMUM  VARIANCE/MINIMUM  VARIANCE  =  1.644 

H  :  Variances  of  average  time  to  generate  OR  air¬ 
craft  are  equal  for  Baseline,  CND/RTOK's  reduced 
by  1/3,  and  CND/RTOK’s  reduced  by  2/3. 

H  :  Variances  of  average  time  to  generate  OR  air¬ 
craft  are  not  equal  for  3aseline,  CND/RTOK's 
reduced  by  1/3,  and  CND/RTOK's  reduced  by  2/3. 

Since  the  P  values  for  Cochran's  C  and  Bartlett-Box  tests  are 

greater  than  0.000,  cannot  reject  the  null  hypothesis  that 

the  variances  are  equal.  Therefore,  ANOVA  can  be  used  to  test 

the  difference  of  means. 
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APPENDIX  HU 

DUNCAN’S  MULTIPLE  RANGE  TEST  AND  ONE-WAY  ANALYSIS 
OF  VARIANCE  OF  CND  ACTIONS 
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MULTIPLE  RANGE  TEST 


DUNCAN  PROCEDURE 
RANGES  FOR  THE  .050  LEVEL  - 
2.32  2.96 


SUBSET  1 

GROUP 

CND  2/3 

CND  1/3 

BASELINE 

MEAN 

4239.67 

4257 . 16 

4317 . 48 

H  : 

0 

The  means  of  Baseline 
CND's  reduced  by  2/3 

,  CND's  reduced 
are  equal . 

by 

1/3,  and 

H  : 
a 

The  means  of  3aseline 
CND's  reduced  by  2/3 

,  CND's  reduced 
are  not  equal. 

by 

1 / 3 ,  and 

Since  Subset 

1  contains  all  three 

mean  values,  cannot 

reject 

the  null  hypothesis  that  the  means  of  Baseline,  CND ' s  reduced 
by  1/3,  and  CND's  reduced  by  2/3  are  equal. 
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ONE-WAY  ANALYSIS  OF  VARIANCE 


GROUP 

COUNT 

MEAN 

STD  DEV 

95-  PCT  CONF 

'  INT  FOR  MEAN 

Baseline 

27 

43 17  - ^8 

279.37 

4206.97 

to 

4427.99 

CND  1/3 

27 

4257. 16 

274.48 

4148.58 

to 

4365.74 

CND  2/3 

27 

4239.67 

253.59 

4139.36 

to 

4339.99 

TOTAL 

81 

4271.44 

H  :  The  difference  in  means  of  Baseline,  CND ' s 

reduced  by  1/3,  and  CND ' s  reduced  by  2/3  are  not 
statistically  significant. 

H  :  The  difference  in  means  of  Baseline,  CND's 

reduced  by  1/3,  and  CND’s  reduced  by  2/3  are 
statistically  significant. 

Since  the  95^  Confidence  Interval  for  all  three  actions  hook 
each  other,  we  cannot  reject  the  null  hypothesis  that  the 
means  of  Baseline,  CND's  reduced  by  1/3,  and  CND's  reduced  by 
2/3  are  not  statistically  significant. 
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DUNCAN’S 

ANALY 


APPENDIX  H5 

MULTIPLE  RANGE  TEST  AND  ONE-WAY 
SIS  OF  VARIANCE  OF  RTOK  ACTIONS 
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MULTIPLE  RANGE  TEST 

DUNCAN  PROCEDURE 
RANGES  FOR  THE  .050  LEVEL  - 
2.82  2.96 

SUBSET  1 
GROUP 
MEAN 

SUBSET  2 
GROUP 
MEAN 


SUBSET  3 

GROUP 

BASELINE 

MEAN 

4317.48 

H  :  The  means  of  Baseline,  RTOK's  reduced  by  1/3, 
and  RTOK's  reduced  by  2/3  are  equal. 

H  :  The  means  of  Baseline,  RTOK's  reduced  by  1/3, 
and  RTOK's  reduced  by  2/3  are  not  equal. 

Since  the  means  of  all  three  actions  are  in  different  sub¬ 
sets,  reject  the  null  hypothesis.  We  can  accept  the  alterna 
tive  hypothesis  that  the  means  of  Baseline,  RTOK's  reduced  b 
1/3,  and  RTOK's  reduced  by  2/3  are  not  equal. 


RTOK  1/3 
3971.50 


RTOK  2/3 
3611.45 
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ONE-WAY  ANALYSIS  OF  VARIANCE 


GROUP 

COUNT 

MEAN 

STD  DEV 

95  PCT  CONF 

'  INT  FOR  MEAN 

Baseline 

27 

4317.^8 

279.37 

4206.97 

to 

4427.99 

RTOK  1/3 

27 

3971.50 

283.96 

3859.17 

to 

4083.83 

RTOK  2/3 

27 

3611. 45 

293.06 

3495.52 

to 

3727.38 

TOTAL 

81 

3966.81 

H  :  The  difference  in  means  of  Baseline,  RTOK's 

reduced  by  1/3,  and  RTOK's  reduced  by  2/3  are 
not  statistically  significant. 

H  :  The  difference  in  means  of  Baseline,  RTOK's 

reduced  by  1/3,  and  RTOK's  reduced  by  2/3  are 
statistically  significant. 

Since  the  95*  Confidence  Interval  for  all  three  actions  do 
not  hook  each  other,  we  reject  the  null  hypothesis  and  accept 
the  alternative  that  the  difference  in  means  of  Baseline, 
RTOK's  reduced  by  1/3,  and  RTOK's  reduced  by  2/3  are  statis¬ 
tically  significant. 
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APPENDIX  K6 

DUNCAN’S  MULTIPLE  RANGE  TEST  AND  ONE-WAY 
ANALYSIS  OF  VARIANCE  OF  CND/RTOK  ACTIONS 
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MULTIPLE  RANGE  TEST 


DUNCAN  PROCEDURE 


RANGES 

FOR 

THE  .050  LEVEL  - 

2 

.82 

2.96 

SUBSET 

1 

GROUP 

CND/RTOK  2/3 

MEAN 

3219.95 

SUBSET 

2 

GROUP 

CND/RTOK  1/3 

MEAN 

3793-28 

SUBSET 

3 

GROUP 

BASELINE 

MEAN 

9317.98 

H  :  The  means  of  Baseline,  CND/RTOK's  reduced  by 
1/3,  and  CND/RTOK's  reduced  by  2/3  are  equal. 

H  :  The  means  of  Baseline,  CND/RTOK's  reduced  by 
1/3,  and  CND/RTOK's  reduced  by  2/3  are  not 
equal.  '  ' 

Since  the  means  of  all  three  actions. are  in  different  subsets, 

reject  the  null  hypothesis.  We  can  accept  the  alternative 

hypothesis  that  the  means  of  Baseline,  CND/RTOK's  reduced  by 

1/3,  nd  CND/RTOK's  reduced  by  2/3  are  not  equal. 
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ONE-WAY  ANALYSIS  OP  VARIANCE 


GROUP 

COUNT 

MEAN 

STD  DEV 

95  PCT  CONF  INT  FOR  MEAN 

Baseline 

27 

4317. ^8 

279.37 

4206.97 

to 

4427.99 

CND/RTOK 

1/3 

27 

3793.28 

217.87 

3707.09 

to 

3879.46 

CND/RTOK 

2/3 

27 

3214.95 

255.09 

3114.04 

to 

3315.86 

TOTAL 

81 

3775.24 

H  :  The  difference  in  means  of  Baseline,  CND/RTOK’s 
reduced  by  1/3,  and  CND/RTOK's  reduced  by  2/3 
are  not  statistically  significant. 

H  :  The  difference  in  means  of  Baseline,  CND/RTOK's 
reduced  by  1/3,  and  CND/RTOK's  reduced  by  2/3 
are  statistically  significant. 

Since  the  95%  Confidence  Interval  for  all  three  actions  do 

not  hook  each  other,  we  reject  the  null  hypothesis  and  accept 

the  alternative  that  the  difference  in  means  of  Baseline, 

CND/RTOK's  reduced  by  1/3,  and  CND/RTOK's  reduced  by  2/3  are 

statistically  significant. 
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